applied big data analytics
Everyone wants to plug an LLM into their app, but few know where its training data came from, or how to retrain it responsibly. Everyone wants a "magic" ML model, yet most struggle to transform terabytes of raw logs into usable features. Knowledge graphs are on every roadmap, but almost nobody knows how to model or populate them at scale. Everyone craves real-time dashboards, but wiring stream processors that scale globally is non-trivial. And when it comes to securing data pipelines or turning notebooks into production workflows with repeatable MLOps, even seasoned engineers are guessing.
Applied Big Data Analytics closes those gaps. Each week we start with a real-world scenario (fraud detection at a fintech, content ranking for a social platform, predictive maintenance in energy) then build an end-to-end solution using the right mix of distributed systems, probabilistic data structures, graph technology, real-time stream processing, governance controls, and production-grade MLOps. By the end of the course you will have designed, deployed, and stress-tested industry-grade data products: from data lakes that feed knowledge graphs, to LLM fine-tuning pipelines, to secure streaming inference services. You'll leave not just knowing the buzzwords, but having built the systems behind them.
- Administrivia
- Analyzing Petascale Financial Dataanalytics · Hadoop / Spark
- Storing Petascale Financial Datawarehouses, lakes & meshes
- Indexing, Searching & Managing Social Media DataHLLs · inverted indexes
- Detecting Fraud with Connected Datagraph analytics
- Making an LLM Smarterknowledge graphs & GraphRAG
- Segmenting E-commerce Usersclustering & dimensionality reduction
- Predicting Customer Churnfeature engineering & hyper-parameter tuning
- Estimating Real Estate Pricesmodel drift · MLOps
- Forecasting Industrial Machine Failurestime-series · neural nets
- Democratising Healthcare Analyticsmeta-learning & distributed AutoML
- Analyzing an Infinite IoT Sensor Datastreamreal-time stream processing
- Interpreting World Development Indicatorsexplainable AI
- Analyzing Data in a Chaotic & Unsecure Worldprivacy-preserving ML