Attention Residuals: rethinking the transformer's core assumption
Transformers once used attention to decide what words matter. Now they're learning to decide what thoughts matter across layers.
Read the post →Innovation leader at Hong Kong Customs, award-winning composer and conductor, and Doctor of Business Administration in Generative AI — one practitioner who has spent more than two decades inside all three rooms simultaneously.
25+ years leading AI, blockchain, cloud and data programmes at Hong Kong Customs — from airport risk systems to a RAG knowledge base.
Explore ↓CASH composer since 1999, former TVB music director, Hong Kong Sinfonietta violinist — with international composition and conducting wins in 2026.
Explore ↓Doctor of Business Administration in Generative AI (Golden Gate University), MIT Sloan AI Executive Academy scholar, JIDS journal author, ETHOS founding council member.
Explore ↓Composer, public-sector leader, doctoral researcher — the integration claim needs all three.
I write neither as a technologist explaining music to musicians, nor as a musician explaining
technology to technologists — but as a practitioner inside all three rooms at once.
Head of Project Planning & Development Division II and inaugural Head of the Innovation and Technology Strategic Development Division (2022–24), Hong Kong Customs — 25+ years in risk management and emerging technologies across Hong Kong's public infrastructure.
Composer and author — creator, orchestrator, storyteller — in traditional and AI-assisted music composition.
Doctor of Business Administration — AI researcher, analyst, scholar — trained within the San Francisco / Silicon Valley generative-AI ecosystem.
Scholar of the AI Executive Academy — MIT Sloan School of Management & MIT Schwarzman College of Computing, Cambridge, Massachusetts — the world's No. 1 MBA, embedded with AI leadership.
“Most people think AI leadership is about learning tools. I've learned it's actually about learning judgment.”
Completed the MIT AI Executive Academy and earned my Executive Certification in Digital Business — a journey that was never about collecting credentials, but about reshaping how we think, decide and lead in an AI-redefined era.
Founding Council Member of ETHOS — a global charitable foundation devoted to Emerging Technology for Human Optimization & Sustainability — and Head of its Advisory Board for Emerging Technology, bringing public-sector, creative and research experience to technology that serves people.
Public service and technology on one side; music and scholarship on the other.
Designed COMPASS — the COMputerized Profiling Analysis and Screening System — for risk management at Hong Kong International Airport, and joined the International Workshop for Accreditation of Risk Management Advisors (2012).
Systems DesignWCO Data Model Project Team member and data steward for the Customs Data Model; moderator of the Blockchain session at the WCO Disruptive Technology Workshop (2021).
InternationalDesigned and led the Community Isolation Facilities Collaboration and Operation (Co-Op 營健通) Platform — a contactless crowd-management cloud platform built with privacy and ethics at its core.
Cloud & EthicsInaugural Head of the Innovation and Technology Strategic Development Division, Hong Kong Customs. Bronze Winner at the Hong Kong ICT Awards 2022; WITSA 2023 nominee; Speaker & Coordinator at InnoEX 2023–24.
LeadershipComposer member of CASH; professional violinist with the Hong Kong Sinfonietta and former Music Director at TVB — Hong Kong's dominant broadcaster.
MusicGraduated from Golden Gate University, San Francisco (Cohort 5), with doctoral research on generative AI within the Silicon Valley ecosystem; Scholar of the MIT Sloan School AI Executive Academy.
Graduated 2026Published in the Joint International DBA Studies (JIDS) Journal. Founding Council Member and Head of Advisory Board (Emerging Technology) of the ETHOS Global Charitable Foundation.
ResearchWinner of the Hong Kong 1st MusicalCon Composition Competition and of the Bach and Fenix International Music Competitions in Conducting; advisory board member of the In-heritage Philharmonic Orchestra. Writing The Human-Machine Duet.
MilestonesCOMputerized Profiling Analysis and Screening System — risk management for Hong Kong International Airport.
Community Isolation Facilities Collaboration & Operation Platform — COVID-19 emergency contactless crowd-management cloud platform.
Speech recognition, NLP, chatbots at HKIA and boundary control points, video analytics and a retrieval-augmented generation knowledge base.
Milestones across technology and music that I'm grateful for.
Solution for Business & Public Sector Enterprise — the COVID-19 Patient and Caretaker Management Platform.
Winning original composition, with broad local media coverage.
International recognition in orchestral conducting.
International recognition in orchestral conducting.
World Innovation, Technology and Services Alliance — nominee for Hong Kong, China.
Intellectual property rights enforcement with global collaboration at Hong Kong Customs.
A running diary of my talks and appearances across AI summits.
On stage not just as a speaker, but as MC and facilitator — alongside distinguished professors and global experts, exploring a shift far deeper than technology adoption: from AI to Augmented Intelligence.
“Schooling in the AI Era — Leading Transformation & Driving Development” · Hong Kong · featured on China Daily HK
World Customs Organization · guiding transnational discussions on blockchain applications and workflows
International Innovation Expo · Smart Government + Smart Economy + Smart People solutions
Keynote speaker and panel member · knowledge management and innovation across Asia
With the Hong Kong Polytechnic University's Behaviour and Knowledge Engineering (BAKE) Research Centre
International accreditation workshop · risk management profession
Professional workshops bridging generative AI and live music creation
Peer-reviewed research and writing in progress.
A transformer-assisted mapping pipeline that resolves semantic inconsistencies and version compatibility in the WCO Data Model — combining automated retrieval and ranking with mandatory validation constraints and human oversight, evaluated through design-science methodology for safe AI deployment in the public sector.
A practitioner's guide to generative AI creativity across five layers — Artificial & Augmented Intelligence, Blockchain & Big Data, Cloud Computing, Data Strategy and Ethical Governance — treating provenance, value exchange and governance as one integrated infrastructural problem, validated in the music ecosystem.
Diagrams and infographics from my LinkedIn — click any of them to open the full post.
Rethinking the transformer's most fundamental assumption — click to read the post.
What AI help gives today — and can quietly take away tomorrow.
A planetary radar of maturity, momentum and mass — Human Optimization at the core.
The ABCDE of GenAI creativity — technology, creativity, humanity.
My writing on AI — from LinkedIn to here. Click a post to read it in full.
Transformers once used attention to decide what words matter. Now they're learning to decide what thoughts matter across layers.
Read the post →The risk is not AI assistance itself. The risk is unscaffolded assistance.
Read the post →The real question is not which technology matures first — it's which will truly augment human capability and create responsible value.
Read the post →Resources I recommend to students, executives and fellow researchers.
Invite me to speak, collaborate on research, or explore AI, innovation and creativity for your organisation.
I share my digital card personally. Send me a quick email and I'll get it right over to you.
✉️ Request by emailThe recent paper “𝗔𝘁𝘁𝗲𝗻𝘁𝗶𝗼𝗻 𝗥𝗲𝘀𝗶𝗱𝘂𝗮𝗹𝘀” introduces a rethink of residual connections — the backbone of every modern transformer.
A subtle but important shift in LLM architecture just dropped — and it challenges one of the most fundamental assumptions in deep learning.
The problem: today's models blindly accumulate outputs from every layer with equal weight. Over depth, this creates “signal dilution” — earlier insights get buried, and later layers must overcompensate.
The breakthrough: replace static residuals with attention over layers. Each layer dynamically decides which prior representations matter, using learned, input-dependent weights.
In short:
👉 Models stop treating all past computation equally
👉 Depth becomes selective, not cumulative
👉 Information retrieval across layers becomes intentional
To make this practical at scale, the authors introduce Block Attention Residuals, reducing memory overhead while preserving gains — making it viable for production-scale LLMs.
Why this matters for AI leaders: we're entering the era of “depth efficiency”. Scaling is no longer just about more layers — it's about using depth intelligently. Architectural innovation is back at center stage: after years of data + compute scaling, we're seeing meaningful gains from rethinking core primitives. And there are implications for cost-performance curves — if models can extract more value per layer, this could materially shift training and inference economics.
A broader pattern: attention is expanding beyond tokens → now across time, modalities… and depth itself.
Transformers once used attention to decide what words matter.
Now they're learning to decide what thoughts matter across layers.
That's a meaningful step toward more adaptive — and ultimately more efficient — intelligence.
AI assistance may improve performance today — while weakening independent performance tomorrow.
A recent preprint by Grace Liu, Brian Christian, Tsvetomira Dumbalska, Michiel A. Bakker and Rachit Dubey raises an important question for the AI era: what happens when a system is optimized to give immediate help, but not necessarily to build long-term human capability?
Across three randomized controlled trials with 1,222 recruited participants, the researchers found a consistent pattern. AI assistance improved short-term performance during the assisted phase. But when AI was removed, participants performed worse on their own and were more likely to give up. The effect appeared after only about 10 minutes of AI-assisted interaction.
The paper's central insight is not that AI is harmful by nature. It is that current AI assistants may act as short-term collaborators: highly useful in the moment, but not necessarily designed to protect the user's future autonomy, persistence, or independent reasoning.
This distinction matters. A good mentor does not simply provide answers. A good mentor scaffolds learning, calibrates support, tracks progress, and sometimes withholds direct help so that the learner can develop the capacity to persist. The concern raised by the study is that AI systems, when used mainly as answer machines, may remove the very struggle through which skill and confidence are built.
One finding is especially important: the downstream decline was concentrated among participants who used AI to obtain direct solutions. Those who asked for answers showed lower later performance and lower persistence than those who used AI for hints or understanding.
The risk is not AI assistance itself.
The risk is unscaffolded assistance.
For education, work, and organizational learning, the implication is clear. We should not judge AI only by immediate task completion. We should also ask whether it strengthens the human capacity to perform when the tool is absent.
The better design question is not “How fast can AI give the answer?” — it is “How can AI help people remain capable, persistent, and independent after the answer is gone?”
That may be one of the most important design challenges for responsible AI: building systems that do not merely complete tasks for humans, but help humans preserve the ability to think, struggle, and learn.
Source: Liu, G., Christian, B., Dumbalska, T., Bakker, M. A., & Dubey, R. (2026). AI Assistance Reduces Persistence and Hurts Independent Performance. arXiv:2604.04721.
When I first looked at the Generative AI impact radar (from Gartner), I did not only see a technology landscape. I saw a planet. And the centre of this planet should not be the model. It should be Human Optimization.
Each of the dots has its own maturity timeline. Each has its own weight of impact. Each may reshape how organizations think, build, decide, and serve. The real question is not simply: which technology will mature first? The deeper question is: which will truly augment human capability, improve institutional intelligence, and create responsible value?
That is why I placed Human Optimization at the core, and Human Augmentation on the crust. Because AI should not only automate tasks — it should extend human judgment, creativity, productivity, and decision-making capacity.
At the same time, this planet is not calm. There are earthquake shockwaves: employment and organizational changes. There are volcanoes: eruptions of new models and game-changing use cases. There are vast oceans: a vast ocean for use cases and markets, for research, and an even deeper ocean for responsible governance.
And a warning from the build-and-data side: Garbage In, Garbage Out. Data quality, governance, provenance, and contextual grounding are no longer back-office technical issues. Poor data does not only create poor outputs; it creates poor decisions, poor trust, and poor institutional learning.
For leaders, the real leadership challenge is to navigate this planet wisely: to identify what is ready now, what is emerging next, what requires governance before scale, what may disrupt people and structures, and what can genuinely create human-centered transformation.
GenAI will not be won by those who only chase the newest model. It will be shaped by those who can connect models, data, governance, workflow, human judgment, and organizational purpose into one coherent operating system.
The destination: where technology does not replace the human mission, but expands what humans and organizations can responsibly achieve.
That's why I relearn and create the value for our future generations, through my own study and creation of the global collaboration ahead.
Artificial Intelligence and Augmented Intelligence, Blockchain & Big Data, Cloud Computing, Data Strategy, Ethical Governance.
Technology. Creativity. Humanity.
Building a harmonious future.
The concept behind my doctoral research and my book in progress, The Human-Machine Duet: The ABCDE Guide for GenAI Creativity — where the five layers play together like a chord, and creativity connects them all.
Honoured to have taken the stage — not just as a speaker, but as the MC and facilitator — alongside distinguished professors and global experts at this meaningful gathering on Educational Innovation in the AI Era.
Together, we explored a shift that is far deeper than technology adoption. It is a shift in how we think about intelligence itself.
At the heart of my sharing — “From AI to Augmented Intelligence” — is a simple but urgent proposition:
We are not here to replace human intelligence.
We are here to elevate it.
In a world increasingly shaped by generative AI, the real question is no longer: “What can AI do?” But rather: “What should humans become — with AI?”
Across the dialogue, several themes strongly resonated:
🔹 From knowledge transfer to knowledge transformation. Learning is no longer about consuming information, but about synthesising, contextualising, and applying it with judgment.
🔹 From individual intelligence to collective intelligence. With AI as a collaborator, classrooms, organisations, and societies are becoming ecosystems of co-creation.
🔹 From tools to trust. The future of AI in education is not defined by capability alone — but by governance, ethics, and responsibility.
As MC and facilitator, what struck me most was not just the diversity of perspectives — but the convergence of conviction:
👉 The future of education is not AI-driven.
👉 It is human-centered, AI-augmented.
This aligns deeply with my ongoing doctoral journey and practice: AI is not the destination. Augmented Intelligence is.
We are not just building smarter systems — we are shaping smarter humans, smarter institutions, and a more thoughtful society.
Grateful to be part of this dialogue — and even more excited about what comes next. Let's continue to build, question, and co-create.
Most people think AI leadership is about learning tools.
I've learned it's actually about learning judgment.
Honoured to have completed the MIT AI Executive Academy and earned my Executive Certification in Digital Business. This journey was never about collecting credentials. It was about reshaping how we think, decide, and lead in an AI-redefined era.
What makes this experience truly distinctive is the intellectual depth behind it. The Academy is delivered by esteemed professors and scholars across a wide spectrum of academic bodies within the Massachusetts Institute of Technology (not exhaustive), including:
🏛️ Schools & Colleges
🔬 Departments & Academic Disciplines
🧠 Research Labs & Institutes
What I take away — in this rocket-paced AI era, one conviction has become even clearer: we should not stop at using AI. We must learn to govern it, contextualize it, and augment with it.
From Artificial Intelligence → Augmented Intelligence:
Elevate human judgment,
Anchor responsibility,
Build systems of trust.
The real value — beyond the curriculum, what made this journey exceptional was the people. Deeply grateful for the wisdom and truly practical insights shared by an incredible global cohort spanning 19 countries. It felt less like a classroom, and more like a living system of global intelligence.
In the age of AI, the real competitive advantage is not intelligence — it is fast, responsive and responsible judgment.
Moving forward — the question is no longer “What can AI do?” but “What should we do with AI — responsibly, ethically, and at scale?” This milestone continues to shape my journey in bridging AI, governance, and human-centered design — into what I call The Human–Machine Duet.