Science that builds and organises knowledge.
SciBit's research output spans AI architecture, signal processing and applied engineering. Papers are published here as they are completed.
Published paper
2026PhiTransformer
We propose PhiTransformer, a geometry-aware Transformer guided by phyllotaxis (golden angle) and fractal self-similarity. Tokens occupy a golden-angle spiral; attention combines annulus-banded locality with φ-scaled hierarchical "spine" links; embeddings may be tied across φ-scales. The resulting O(n log n) connectivity aims to reduce attention compute while preserving long-range information flow.
We formalise the topology, provide CPU and Triton reference kernels, estimate training/inference gains, and outline an experimental plan for validation. Claims of efficiency are explicitly speculative pending experiments.
↓ Download PDFPublished by SciBit Scientific Bitware Pty Ltd · Bloemfontein, South Africa · This paper is a hub for future research output — additional publications will appear here as completed.