Reinforcement Learning with Ray RLlib (V2)
Data Day Texas, 2023
Updated version of my talk on Ray's powerful reinforcement learning library, RLlib. This talk discusses reinforcement learning and how to use RLlib.
Dean Wampler, Ph.D.
Industry expert in AI/ML engineering, streaming data, and Scala.
Author and industry public speaker.
Works for IBM Research. Photographer. Lives in Chicago.
Books & Reports
More information on my books and reports.
Some of My Talks
Lessons Learned from 15 Years of Scala in the Wild
Several Conferences, 2021-2022
Since I joined the Scala community roughly 15 years ago, the Scala community has learned a lot to make the language more robust and easier to use effectively. I've also learned lots of lessons about effective "enterprise" programming using Scala. Finally, I see warning signs for FP's future growth.
Next Generation AI: Transitioning to the Continuous, Self-Learning Enterprise
Draft, February 2021
A talk I'm developing that looks at the state of AI/ML and what enterprises need to do to fully leverage it.
Modularity: A Retrospective
GOTO Chicago Nights, February 18, 2020 and Scala in the City, May 28, 2020
A look at what we've accomplished in making software modular and where we need to go.
Cluster-wide Scaling of ML with Ray
YOW! Data, July 1, 2020, and CodeMesh, Nov., 2020
Ray is a distributed computing system that offers a concise, intuitive API, with excellent performance for distributed workloads. It emerged out of the AI community at U.C. Berkeley.
Executive Briefing: What It Takes to Use ML in Fast Data Pipelines
Strata San Francisco, London, and NYC 2019
A briefing for managers and executives about the challenges of serving ML models in a streaming data context.
Executive Briefing: What You Need to Know about Fast Data
Strata London and NYC 2018
A briefing for managers and executives about the trends in Fast Data and how the impact on their organizations.
Download PDF
Watch video (A similar webinar)
Streaming Microservices with Akka Streams and Kafka Streams
Strata San Jose and London 2018, Scala Days NYC 2018, Reactive Summit 2018, YOW! 2018
I discuss processing data in microservices using Akka Streams and Kafka Streams, vs. using tools like Spark and Flink.
Stream All the Things!!
Software Architecture Conference NYC 2017, Strata London and NYC 2017
I discuss the emerging architecture for large-scale stream data processing, that also integrates the best of microservice architectures.