|
--- |
|
license: mit |
|
--- |
|
|
|
This is a new kind of model optimization. |
|
This model is based on Meta-Llama-3.1-8B. |
|
|
|
A paper is currently being written on the technique. Special thanks to my wife, for putting up with me coding in the basement for too many evenings and weekends for months! |
|
|
|
## Quickstart |
|
|
|
```python |
|
import transformers |
|
import torch |
|
|
|
model_id = "meta-llama/Meta-Llama-3.1-8B" |
|
|
|
pipeline = transformers.pipeline( |
|
"text-generation", model=model_id, model_kwargs={"torch_dtype": torch.bfloat16}, device_map="auto" |
|
) |
|
|
|
pipeline("Hey how are you doing today?") |
|
``` |
|
|
|
|
|
___________________________________ |
|
# *ADVERTISING BREAK* |
|
|
|
I’m on the hunt for new challenges and a chance to dive into some exciting research opportunities. Oh, and did I mention I just snagged a top spot on the Open LLM leaderboard? 🎉 |
|
|
|
|
|
|
|
## CV - Dr David Noel Ng |
|
|
|
|
|
#### Profile |
|
Innovation enthusiast, AI-strategist, and interdisciplinary-tech nerd – that's me! With over a decade of experience in research and project management, my professional journey has been largely shaped by my passion for artificial intelligence and its potential to transform various industries. With a solid background in artificial intelligence and machine learning, coupled with a knack for innovation and problem-solving (and a healthy dose of curiosity), I'm excited to bring my skills to a new team. |
|
|
|
Originally from Australia, where I earned my degrees in Organic Chemistry and Biochemistry, I moved to Germany in 2004. My academic pursuit continued with a Ph.D. in Chemistry at the Max Planck Institute of Biochemistry. Today, I leverage my robust educational background and diverse industry experience to drive AI innovations in a wide range of applications. Hobbies? Lots: I've also built the world's most powerful espresso machine and am working to bring [GLaDOS to life](https://github.com/dnhkng/GlaDOS). |
|
|
|
|
|
___________________________________ |
|
### PROFESSIONAL EXPERIENCE |
|
#### SENIOR GLOBAL INNOVATION STRATEGIST - ARTIFICIAL INTELLIGENCE |
|
#### Munich Re | Munich | 05/2023 - Now |
|
|
|
As a Senior Global Innovation Strategist at Munich Re, my passion is in steering AI/ML strategies, maximizing project impact, and advancing the use of cutting-edge technology. I built the AI Accelerator, which drives the rapid and structured development of AI use-case Implementations. |
|
#### AI CONSULTANT - LEAD AI ENGINEER |
|
#### appliedAI UTUM | Munich | 04/2019 - 04/2023 |
|
|
|
In my tenure at appliedAI, I held a leadership role where I spearheaded the successful development and execution of various AI/ML proof-of-concept (POC) and minimum viable product (MVP) projects. I utilized a hands-on approach to drive ideation, planning, and delivery of these solutions for our clients. |
|
|
|
- AI-Controlled Imaging: Directed a PoC of an AI-Controlled Electron Microscope using Reinforcement Learning for a premier imaging company. |
|
- Anomaly Detection: Oversaw development of security systems utilizing anomaly detection, integrating diverse technologies to boost client security at the Munich Security Conference.. |
|
- Project Optimization: Implemented AlphaZero-based Graph Optimization for project management in the Nuclear Energy sector. |
|
- Food Safety: Delivered a PoC for industrial food safety equipment, significantly improving detection sensitivity. |
|
- NLP Consulting: Consulted on automated document analysis and risk assessment for the European Central Bank, leveraging NLP technologies. |
|
- Aerospace Anomaly Detection: Developed a PoC for Aerospace manufacturing, using generative diffusion models to create synthetic data for training anomaly detection models. |
|
- Retail Automation: Applied Vision and Skeletal Tracking for supermarket automation, modernizing retail operations. |
|
- Public Speaking and Training: Regularly presented talks and training sessions on topics such as KI-Transfer Plus for the Bayerischen Staatsministeriums für Digitales, and KI in Biotech for the BioEntrepreneurship Summit, spreading AI knowledge and fostering digital transformation in the Health/Pharma sector.. |
|
|
|
|
|
#### PROJECT LEAD - INNOVATIVE TECHNOLOGIES |
|
#### Nanotemper Technologies GmbH | Munich | 5/2016 - 3/2019 |
|
|
|
Project Lead in the Future Technologies Department, Scientist Bioanalytics and all-rounder in bioanalytics/data/optoelectronics. Contributions and successes: |
|
- Created and applied Deep Learning models for interpreting biophysical data for pharmaceutical stability in antibody development |
|
- Designed, built, and programmed prototype optoelectronic apparatus for the rapid analysis of biosimilar pharmaceutical molecules |
|
- Introduced FPGA technology for high-speed data collection and analysis, now used in the key products at Nanotemper |
|
|
|
#### RESEARCH SCIENTIST |
|
#### Max Planck Institute Of Neurobiology | Martinsried | 02/2016 - 04/2019 |
|
|
|
Driven by an interest in Biotech, I found a role in research working on biosensors, particularly on optical probes of neural activity (Optogenetics). Contribution and success: |
|
- Designed, built and utilized a robotic screening platform for the high-throughput engineering of biosensors. |
|
- Utilised image-processing and machine-learning techniques to collect and analyse biosensor data. |
|
- Automated the development of large molecules by FACS-based directed protein evolution. |
|
- Patented new CRISPR/Cas9 technology for high-throughput protein engineering. |
|
|
|
#### CONSULTANT FOR THE NETFLIX SERIES 'BIOHACKERS' |
|
#### Netflix | Munich | 01/2019 - 12/2019 |
|
|
|
In this role, I advised on the scientific concepts, storylines and film set for this popular Netflix series. Contribution and success: |
|
- Helped design and build the Laboratory and ‘Biohacking’ labs |
|
- Modified the scripts to keep scientific accuracy |
|
- Location scouting and liaison with the LMU to organise research labs for filming |
|
|
|
#### Doctoral Candidate |
|
#### Max Planck Institute for Biochemistry |
|
|
|
My PhD thesis was all about Optical brain-computer interfaces, and synthesizing molecular sensors for optically imaging brain activity. I devised a new biomolecular targeting technique and developed compounds for high-speed optical analysis of neuron activity. |
|
- Molecular Sensor Development: Designed, synthesized, and tested molecular sensors to optically image brain activity, advancing neuroimaging capabilities. |
|
- Biomolecular Targeting Technique: Developed a novel technique for labelling live cells with organic dye, utilizing pro-drug techniques used in pharmaceutical development, enhancing the precision of cell tracking and analysis. |
|
- Neuronal Activity Analysis: Designed a high-speed optical analysis setup for cultured neurons and developed specialized compounds for this purpose, improving our understanding of neuron activity. |
|
|
|
## SKILLS |
|
- Strong interest in customer experience and Machine Learning transformations (e.g. expectation management, stakeholder alignment, team reorganization etc.) |
|
- Ability to work autonomously in the completion of deliverables |
|
- Ability to provide technical and analytic direction, guidance and roadmaps for ML projects |
|
- Excellent communication and presentation skills: able to explain Analytics in non-technical terms to business users (C-level, investors, public presentations etc.) |
|
- Deep technical expertise and strong problem-solving and data-analysis skills |
|
|
|
|
|
|
|
## AWARDS |
|
|
|
#### The United Nations COVID-19 Detect & Protect Challenge |
|
- The United Nations Development Programme Centre for Technology, Innovation and Sustainable Development · Aug 2020 |
|
|
|
#### AI at the Edge Challenge with NVIDIA - Artificial Intelligence of Things (AIoT) |
|
- Issued by Nvidia · Mar 2020 |
|
|
|
#### Create Intelligence at the Edge - Artificial Intelligence on FPGA |
|
- Avnet and Xilinx · Dec 2018 |
|
|
|
#### PATENTS |
|
- WO2018020050A1 - Targeted in situ protein diversification by site-directed DNA cleavage and repair |
|
|
|
|
|
## EDUCATION |
|
|
|
#### PhD in Organic Chemistry |
|
- Max Planck Institute of Biochemistry |
|
|
|
#### Honours Degree - Biochemistry |
|
- Monash University Melbourne |
|
|
|
#### Bachelor of Science - Double Major - |
|
- Chemistry / Molecular Biology |
|
- University of Tasmania |
|
|
|
#### Nanodegree - Deep Reinforcement Learning |
|
- Udacity Online |
|
|
|
#### Nanodegree - Deep Learning |
|
- Udacity Online |
|
|
|
|
|
___________________________________ |
|
I'm based out of Munich, Germany, but I would be interested in working remotely for a team with more compute than my 2x 4090s 🚀 |
|
|
|
#### Reach out via [LinkedIn](https://www.linkedin.com/in/dnhkng) |
|
|
