Stay ahead of the rapidly evolving cloud and AI landscape with the AWS for Software Companies podcast.
Hear from renowned software leaders, respected industry analysts, and experienced consultants alongside AWS experts as they explore the technologies shaping the future—from generative AI and agentic systems to intelligent cloud architectures, and modern data management. Learn how AI agents are transforming enterprise workflows, how leading companies are modernizing their cloud strategies with security best practices at the core, and what's driving the next wave of SaaS innovation.
New episodes drop regularly to keep you informed on the trends that matter most to your business.
Learn how Anyscale's Ray platform enables companies like Instacart to supercharge their model training while Amazon saves heavily by shifting to Ray's multimodal capabilities.
Topics Include:
- Ray originated at UC Berkeley when PhD students spent more time building clusters than ML models
- Anyscale now launches 1 million clusters monthly with contributions from OpenAI, Uber, Google, Coinbase
- Instacart achieved 10-100x increase in model training data using Ray's scaling capabilities
- ML evolved from single-node Pandas/NumPy to distributed Spark, now Ray for multimodal data
- Ray Core transforms simple Python functions into distributed tasks across massive compute clusters
- Higher-level Ray libraries simplify data processing, model training, hyperparameter tuning, and model serving
- Anyscale platform adds production features: auto-restart, logging, observability, and zone-aware scheduling
- Unlike Spark's CPU-only approach, Ray handles both CPUs and GPUs for multimodal workloads
- Ray enables LLM post-training and fine-tuning using reinforcement learning on enterprise data
- Multi-agent systems can scale automatically with Ray Serve handling thousands of requests per second
- Anyscale leverages AWS infrastructure while keeping customer data within their own VPCs
- Ray supports EC2, EKS, and HyperPod with features like fractional GPU usage and auto-scaling
Participants:
See how Amazon Web Services gives you the freedom to migrate, innovate, and scale your software company at https://aws.amazon.com/isv/