Commit Graph

13 Commits (a59d3139d4ecb0f934f2ed02268bdf38e7bd73ca)

Author SHA1 Message Date
Ibrahim Numanagić 47a2745f06
Better Jupyter support & Polymorphism improvements (#363)
* Remove vtables from objects (use __id__ only); Add static itemgetter

* Migrate to XEUS 3

* Fix XEUS patches

* Fix docs [skip ci]

* Use tuples for RTTI classes

* clang-format

* Add polymorphic to IR RefType

* Pass isPolymorphic to IR

* Update codegen for new poly ref types

* New RTTI memory layout; Fix #346

* Ellipsis class; handle ellipses

* Move all generated magics to Codon (__magic__)

* Fix vars_types

* Update polymorphic setter

* Fix compiler warnings

* Fix pyext assert

* Update ellipsis

* Update pure/derives tags

* Update dataclass order magics

* Add pure/derives tags

* Fix partial printing

* Add extra tuple test

---------

Co-authored-by: A. R. Shajii <ars@ars.me>
2023-05-10 09:28:25 -04:00
A. R. Shajii 5613c1a84b
v0.16 (#335)
* Add Python extension lowering pass

* Add DocstringAttribute

* Add extension module codegen

* Handle different argument counts efficiently

* Add warnings to extension lowering

* Fix module name

* Fix extension codegen

* Fix argument check

* Auto-convert Codon exceptions to Python exceptions

* Fix #183

* Fix #162; Fix #135

* Fix #155

* Fix CPython interface in codegen

* Fix #191

* Fix #187

* Fix #189

* Generate object file in pyext mode

* Convert Codon exceptions to Python exceptions

* Fix vtable init; Fix failing tests on Linux

* Fix #190

* Fix #156

* Fix union routing

* Remove need for import python

* Automatic @export and wrapping for toplevel functions

* Reorganize API

* Add Python extension IR structs

* Add special calls for no-suspend yield-expr

* Add special calls for no-suspend yield-expr

* pyextension.h support [wip]

* pyextension.h support [wip]

* pyextension.h support

* pyextension.h support for toplevel functions

* clang-format

* Add PyFunction::nargs field

* Update pyextension codegen (WIP)

* SUpport nargs

* Add support for @pycapture

* PyType codegen (WIP)

* Py method codegen (WIP)

* Add type ptr hook

* Add getset codegen

* Add type alloc function

* Add type pointer hook codegen

* Re-organize codegen

* Add member codegen

* Update module init codegen

* Update module init codegen

* Add support for typePtrHook and new to/from_py hooks

* Fix extension codegen

* Fix init codegen

* Fix init codegen; add "tp_new" slot

* Fix type hook

* Add extra flags

* Specialized wrappers (PyType specs)

* Add static Python link option

* Fix C imports

* Add guards

* Remove unused field

* Python mode only when pyExt set

* Update python module

* Fix assert

* Update codegen/passes

* Fix tuple parsing in index expression

* Fix empty tuple unification

* Do not Cythonize underscore fns

* clang-format

* Fix switch

* Add Py support for cmp/setitem

* Add Py support for cmp/setitem

* Add type is support

* GetSet support

* clang-format

* GetSet support (fixes)

* Avoid useless vtable alloc

* Add iter support

* Fix size_t capture bug

* clang-format

* Fix POD type unification with tuples

* Add __try_from_py__ API

* Fix annotation

* Add static reflection methods (setattr; internal.static.*); refactor PyExt to python.codon; handle errors and kwargs in PyExt

* Python compat fixes

* Update Python object conversions

* Fix PyErrors

* clang-format; add copyright

* Add PyFunction::keywords field

* Fix JIT MRO handling; Refactor out Jupyter support

* Refactor out Jupyter support

* Add support for custom linking args (link=[]) to TOML plugins

* Fix tests

* Use g++ instead of gcc

* Fix Jupyter CMAKE

* Fix Jupyter CMAKE

* Add _PyArg_Parser definition

* Add complex64 type

* Add extra complex64 tests

* Fix Python calls; add staticenumerate

* Fix call

* Fix calls

* Update pyext wrappers

* Fix staticenumerate; Support static calls in tuple()

* Fix pyext routing

* Add add/mul for tuples

* clang-format

* Fix pyext codegen

* Fix wrap_multiple

* Add seq_alloc_atomic_uncollectable

* Fix default generics issue

* Add binary/ternary ops

* Fix missing generic issue

* Fix number slots

* Update pow

* Remove unnecessary pyobj

* Fix allocation

* Refactor errors

* Add test extension

* Fix formatting

* clang-format

* Fix getitem/setitem/delitem in pyext

* Fix pyext iterators

* Add builtin pow() (fix #294)

* Fix #244

* Fix #231

* Fix #229

* Fix #205

* Update docs

* Fix error message

* Add pyext tests

* Add pyext support for @property

* Add pyext support for toplevel fns and @tuple classes

* More pyext tests

* More pyext tests

* Fix file error checking

* More pyext tests

* Update pyext tests

* Update docs

* Add pyext test to CI

* Add pyext support for @tuple.__new__

* Add pyext support for @tuple.__new__

* Fix hetero-tuple issue with fn_overloads

* More pyext tests

* Bump versions

* Fix del magic in pyext

* Fix init magic for tuples in pyext

* Have test-pypi only run on develop branch

* Make exception type indices unnamed-addr

* Fix #316; Fix #317 (slash issue)

* Use uncollectible-alloc for vtable

* Fix #249

* Add pyext docs

* Fix #249; Fix clashing vtables; Fix super() and class_copy

* Add content-atomic type property instruction

* __contents_atomic__ support

* Update internal functions

* Use PIC when generating Python extension

* Cleanup

* Add Dockerfile & fix -fPIC

* Cleanup

* Fix setup.py

* Fix pyext fn iteration

* Fix CI

* clang-format

* Update long conversions in Py bridge

* Support wide-int to str conversions

* Fix test

* Add pow for arbitrary-width ints

* Fix Linux backtraces

* Cleanup

* Add more tests

* Fix docs; Remove tuple.__add__ for scalars

* Update docs

---------

Co-authored-by: Ibrahim Numanagić <ibrahimpasa@gmail.com>
2023-04-12 18:13:54 -04:00
A. R. Shajii e1016f9e9a
Upgrade to LLVM 15 (#56)
* Upgrade to LLVM 15 (WIP)

* Call `setPresplitCoroutine()` on coro LLVM funcs

* Use new pass manager

* Update deps

* Update docs

* Fix exceptions on M1

* Add libunwind

* Use Orc and JITLink for "codon run"

* JITLink integration

* Fix callback

* Fix strbuf, fix GC root registration

* Fix test init

* Fix llvm function

* Fix pickle, float atomics

* Add TargetLibraryAnalysis

* Use new LLVM pass manager in GPU codegen

* Fix libunwind linking

* Fix libunwind

* Fix GPU passes

* Don't link libunwind explicitly

* Bump version

* Update plugins for new pass manager

* Fix bash error

* Fix GPU GV extraction

* Move simd module to experimental folder

* Update file read

* Add benchmark programs

* Add dynamic tuple

* Fix parser tuple slicing bug

* Make DynamicTuple interoperable with Tuple

* Fix DynamicTuple GPU interop

* Dockerize builds

* Simplify CMake

* Revert "Simplify CMake"

This reverts commit 08d2920349.

Co-authored-by: Ibrahim Numanagić <ibrahimpasa@gmail.com>
2022-10-14 09:31:10 -04:00
A. R. Shajii ebd344f894
GPU and other updates (#52)
* Add nvptx pass

* Fix spaces

* Don't change name

* Add runtime support

* Add init call

* Add more runtime functions

* Add launch function

* Add intrinsics

* Fix codegen

* Run GPU pass between general opt passes

* Set data layout

* Create context

* Link libdevice

* Add function remapping

* Fix linkage

* Fix libdevice link

* Fix linking

* Fix personality

* Fix linking

* Fix linking

* Fix linking

* Add internalize pass

* Add more math conversions

* Add more re-mappings

* Fix conversions

* Fix __str__

* Add decorator attribute for any decorator

* Update kernel decorator

* Fix kernel decorator

* Fix kernel decorator

* Fix kernel decorator

* Fix kernel decorator

* Remove old decorator

* Fix pointer calc

* Fix fill-in codegen

* Fix linkage

* Add comment

* Update list conversion

* Add more conversions

* Add dict and set conversions

* Add float32 type to IR/LLVM

* Add float32

* Add float32 stdlib

* Keep required global values in PTX module

* Fix PTX module pruning

* Fix malloc

* Set will-return

* Fix name cleanup

* Fix access

* Fix name cleanup

* Fix function renaming

* Update dimension API

* Fix args

* Clean up API

* Move GPU transformations to end of opt pipeline

* Fix alloc replacements

* Fix naming

* Target PTX 4.2

* Fix global renaming

* Fix early return in static blocks; Add __realized__ function

* Format

* Add __llvm_name__ for functions

* Add vector type to IR

* SIMD support [wip]

* Update kernel naming

* Fix early returns; Fix SIMD calls

* Fix kernel naming

* Fix IR matcher

* Remove module print

* Update realloc

* Add overloads for 32-bit float math ops

* Add gpu.Pointer type for working with raw pointers

* Add float32 conversion

* Add to_gpu and from_gpu

* clang-format

* Add f32 reduction support to OpenMP

* Fix automatic GPU class conversions

* Fix conversion functions

* Fix conversions

* Rename self

* Fix tuple conversion

* Fix conversions

* Fix conversions

* Update PTX filename

* Fix filename

* Add raw function

* Add GPU docs

* Allow nested object conversions

* Add tests (WIP)

* Update SIMD

* Add staticrange and statictuple loop support

* SIMD updates

* Add new Vec constructors

* Fix UInt conversion

* Fix size-0 allocs

* Add more tests

* Add matmul test

* Rename gpu test file

* Add more tests

* Add alloc cache

* Fix object_to_gpu

* Fix frees

* Fix str conversion

* Fix set conversion

* Fix conversions

* Fix class conversion

* Fix str conversion

* Fix byte conversion

* Fix list conversion

* Fix pointer conversions

* Fix conversions

* Fix conversions

* Update tests

* Fix conversions

* Fix tuple conversion

* Fix tuple conversion

* Fix auto conversions

* Fix conversion

* Fix magics

* Update tests

* Support GPU in JIT mode

* Fix GPU+JIT

* Fix kernel filename in JIT mode

* Add __static_print__; Add earlyDefines; Various domination bugfixes; SimplifyContext RAII base handling

* Fix global static handling

* Fix float32 tests

* FIx gpu module

* Support OpenMP "collapse" option

* Add more collapse tests

* Capture generics and statics

* TraitVar handling

* Python exceptions / isinstance [wip; no_ci]

* clang-format

* Add list comparison operators

* Support empty raise in IR

* Add dict 'or' operator

* Fix repr

* Add copy module

* Fix spacing

* Use sm_30

* Python exceptions

* TypeTrait support; Fix defaultDict

* Fix earlyDefines

* Add defaultdict

* clang-format

* Fix invalid canonicalizations

* Fix empty raise

* Fix copyright

* Add Python numerics option

* Support py-numerics in math module

* Update docs

* Add static Python division / modulus

* Add static py numerics tests

* Fix staticrange/tuple; Add KwTuple.__getitem__

* clang-format

* Add gpu parameter to par

* Fix globals

* Don't init loop vars on loop collapse

* Add par-gpu tests

* Update gpu docs

* Fix isinstance check

* Remove invalid test

* Add -libdevice to set custom path [skip ci]

* Add release notes; bump version [skip ci]

* Add libdevice docs [skip ci]

Co-authored-by: Ibrahim Numanagić <ibrahimpasa@gmail.com>
2022-09-15 15:40:00 -04:00
Ibrahim Numanagić 48a2bfa57a
Add Cython fixes (decorator arguments, pyvars support) (#42)
* Add Cython fixes (decorator arguments, pyvars support)

* Update CI and README

* Fix problematic test

* Don't track Cython-generated cpp file [ci skip]

* Fix test

* Various codon.jit improvements

* clang-format [ci skip]

* Add docs [ci skip]

* Add docs link

Co-authored-by: A. R. Shajii <ars@ars.me>
2022-08-03 16:36:03 -04:00
A. R. Shajii c128e59132
Annotation updates (#41)
* Fix gitignore, versions

* Add caching (WIP)

* Fix decorator

* Refactor

* Support tuple conversions

* Fix void; allow pyobj default conversion

* Improve setup

* Rename

* Fix JIT output capturing

* Support conversion of "complex"

* Allow class conversions

* Use Python number API

* Use Python API for (get/set/del)item

* Add decorator docs

* Cleanup

* Support slice and optional conversions

* Add comparison magics

* Remove Optional.__invert__() method

* Fix tests

* Fix test

* Add release notes

* New pybridge tests

* Update decorator tests

* Fix optional tuple handling

* Fix optional str() and repr()

* Add more decorator tests

* Fix optional.__bool__

* Update releases.md

* Add op tests

* Organize release notes [skip ci]

* clang-format [skip ci]

* Add r-magics to pyobj; more tests [skip ci]

* More pybridge tests

* Add plugin library paths to build command

* Remove walrus operator [skip ci]

* Fix optional operator handling; Fix right-magic handling

Co-authored-by: Ibrahim Numanagić <ibrahimpasa@gmail.com>
Co-authored-by: Ibrahim Numanagić <inumanag@users.noreply.github.com>
2022-08-02 14:53:17 -04:00
Ibrahim Numanagić cb945f569c
Typechecker refactoring (#20)
* Initial refactor commit

* Support external vars

* Simplify refactor; Python scoping [wip]

* Python scoping [wip]

* Python scoping [fix loops; wip]

* Fix lambdas

* Python scoping [test fixes; wip]

* Fix scoping [wip]

* Fix basic tests [no-ci]

* Fix tests

* CallExpr refactoring [wip]

* CallExpr refactoring [wip]

* Remove activeUnbounds tracking

* Add core.codon

* Move Function and other core types to core.codon; Revamp Function and Callable types

* Refactor IntExpr, FloatExpr and CallExpr

* Refactor ClassStmt

* Refactor context, IdExpr and DotExpr

* Refactor DotExpr and AssignStmt

* Refactor ImportStmt

* Refactor FunctionStmt

* Refactor

* Remove UpdateStmt

* Refactor AssignReplacementVisitor

* Make SimplifyVisitor in-place

* Fix new scoping

* Fix import type alias handling

* Add docstrings; Complete Simplify refactoring

* Fixes for seqtest

* Refactor typecheck [wip]

* Refactor typecheck [wip]

* Refactor typecheck/access; Remove void anduse NoneType; Fix #18

* Refactor typecheck/assign

* clang-format and cmake-format

* Fix none types in IR

* Multi-error support in simplify

* Fix IR tests for new void

* Simplify ClassStmt

* Refactor cond.cpp

* Refactor error.cpp

* Refactor function.cpp and simplify unbounds

* Refactor op.cpp

* Refactor call.cpp [wip] [no-ci]

* seqassertn updates [noci]

* Refactor call.cpp

* Refactor call.cpp

* Refactor call.cpp

* Refactor typecheck

* clang-tidy updates [noci]

* Refactor infer.cpp [wip]

* Refactor infer.cpp

* Refactor wrapExpr

* Remove visitedAsts

* Remove old base logic

* Refactor typecheck ctx

* Fix JIT bug

* Fix JIT tests

* Scoping fixes [wip] [noci]

* Fix ImperativeForFlow var store

* Add newlines [noci]

* Dump IR module with log flag

* Fix scoping bugs; Add &, ^ and | static operations; Address stylistic review issues

* Fix side effect analysis for for-loops

* Add support for class variables and ClassVar

* Refactor special dot-member cases

* Add codon app tests

* Fix class variables; clang-tidy

* Fix __argv__

* Add datetime constants and update tests

* Fix #25; Add Py_None, Py_True and Py_False; External var support [wip]

* External var support [wip]

* Dump LLVM IR when debug flags are active

* clang-format

* Fix arg var construction

* Extern var fixes

* Undo extern var changes related to stdout etc.

* Fix tuple magics

* Fix extern vars and tuple magics

* Fix duplicate var name error

* Fix extern vars

* Fix #16

* Fix side-effect analysis for try-catch

* Move test C var to test executable

* Add staticmethod

* Fix var status for try-catch

* Fix tests

* Fix shell var name

* Fix test

* Fix app test

* Fix scoping issue (remove dominated identifier from stack)

* Fix no-pie issue

* Use PIC when building library object

* Don't use -no-pie when building library [noci]

* Use -relocation-model=pic in test

* Fix lib build on Linux

* Fix lib build

* Update exceptions to use subclasses vs. header

* Fix __repr__

* Fix tests

* Fix exceptions test

* Don't build docs

Co-authored-by: A. R. Shajii <ars@ars.me>
2022-07-26 16:06:00 -04:00
A. R. Shajii 753151157d
Py interop fix (#23)
* Fix incref/decref

* Fixes

* Fix set __to_py__

* Add more Python conversion tests

* clang-format

* Make from_py/to_py use cobj instead of pyobj

* Remove unneeded increfs

* Fix cython

* Ignore __init_test__ in doc generation

* Add exception check

Co-authored-by: Ishak Numanagić <ishak.numanagic@gmail.com>
Co-authored-by: Ibrahim Numanagić <ibrahimpasa@gmail.com>
2022-04-07 00:33:49 -04:00
Ibrahim Numanagić 12e8fe7666
@codon Python decorator and Python interop fixes (#19)
* Codon decorator

* Move to extra/cython, add error handling

* Small fixes

* CR

* CR

* Fix cython CI

* Fix cython CI v2

* Fix cython CI v3

* Fix cython CI v4

* Fix cython CI v5

* Fix cython CI v6

* Fix cython CI v7

* Fix cython CI v8

* Fix cython CI v9

* Fix cython CI v10

* Fix cython CI v11

* CR

* Fix CI

* Fix CI

* Fix CI

* Fix CI

* Fix CI

Co-authored-by: Ishak Numanagić <ishak.numanagic@gmail.com>
2022-03-31 10:22:26 +02:00
A. R. Shajii bf57a4bd48 Add "_" files back 2021-10-02 18:56:18 -04:00
A. R. Shajii 0d185019f3 .seq to .codon 2021-10-01 09:56:35 -04:00
A. R. Shajii d763282137 Rename (wip) 2021-09-30 15:04:26 -04:00
A. R. Shajii ede7765171 Initial commit 2021-09-27 14:02:44 -04:00