← home

teaching.

01

academic courses

lectures, projects, and the grading that comes with them

applied big data analytics

Everyone wants to plug an LLM into their app, but few know where its training data came from, or how to retrain it responsibly. Everyone wants a "magic" ML model, yet most struggle to transform terabytes of raw logs into usable features. Knowledge graphs are on every roadmap, but almost nobody knows how to model or populate them at scale. Everyone craves real-time dashboards, but wiring stream processors that scale globally is non-trivial. And when it comes to securing data pipelines or turning notebooks into production workflows with repeatable MLOps, even seasoned engineers are guessing.

Applied Big Data Analytics closes those gaps. Each week we start with a real-world scenario (fraud detection at a fintech, content ranking for a social platform, predictive maintenance in energy) then build an end-to-end solution using the right mix of distributed systems, probabilistic data structures, graph technology, real-time stream processing, governance controls, and production-grade MLOps. By the end of the course you will have designed, deployed, and stress-tested industry-grade data products: from data lakes that feed knowledge graphs, to LLM fine-tuning pipelines, to secure streaming inference services. You'll leave not just knowing the buzzwords, but having built the systems behind them.

lectures
  1. Administrivia
  2. Analyzing Petascale Financial Dataanalytics · Hadoop / Spark
  3. Storing Petascale Financial Datawarehouses, lakes & meshes
  4. Indexing, Searching & Managing Social Media DataHLLs · inverted indexes
  5. Detecting Fraud with Connected Datagraph analytics
  6. Making an LLM Smarterknowledge graphs & GraphRAG
  7. Segmenting E-commerce Usersclustering & dimensionality reduction
  8. Predicting Customer Churnfeature engineering & hyper-parameter tuning
  9. Estimating Real Estate Pricesmodel drift · MLOps
  10. Forecasting Industrial Machine Failurestime-series · neural nets
  11. Democratising Healthcare Analyticsmeta-learning & distributed AutoML
  12. Analyzing an Infinite IoT Sensor Datastreamreal-time stream processing
  13. Interpreting World Development Indicatorsexplainable AI
  14. Analyzing Data in a Chaotic & Unsecure Worldprivacy-preserving ML
projects
  1. Loan Performance Data Insights
  2. SEC Corporate Filings Insights
  3. NYC Taxi Trip Insights
  4. NYISO Electricity Consumption & Pricing Insights

advanced real-world programming

We have come a long way since the time when it was generally believed that computers themselves would never constitute a scientific field of study, to a time where Computer Science has pervaded and made an impact on nearly all aspects of human life. The "smartness" of computers has enabled us to explore the surface of mars, map the human genome, discover malignant cancer cells, and even discover the "God particle", ad infinitum. At the same time, it is important to remember that a computer by itself is a "dumb" device which needs to be "programmed" to perform actions and tasks.

With all of this in mind, this course has been designed to teach students "to think like a computer scientist". Through a general-purpose programming language, Python, students will be introduced to multiple programming paradigms, including functional, imperative, and object-oriented, with a strong emphasis on writing clean, efficient (both in space and time), and bug-free code. Taking a hands-on approach, we will discuss and analyze how all of these methodologies can be mapped onto real-world problems and algorithms and students will be expected to get their hands dirty. Importantly, rather than getting into the nitty-gritty of these paradigms, this course aims to equip the students with the right skills and tools to venture out into the real world and make an impact in their respective domains.

"The computing scientist's main challenge is not to get confused by the complexities of his own making."
E. W. Dijkstra

course material ↗

zubair nabi ← home