Viral Intwala

Today I have gone through an amazing conversation about how JioCinema is able to scale to an amazing level for 20M concurrent devices and the engineering goes behind the scenes. This discussion between Arpit Bhayani and Prachi Sharma is very much helpful to anyone who is passionate about large scale system design. Also, you can relate to it if you are doing similar practices in your organization. These are few key takeaways, how the company does engineering at this mega scale and serve customers asynchronous non-blocking way - 1. How building appropriate alerts and monitoring helps. 2. Importance of feature flags. Different kinds of flags based on severity. 3. Importance of system audits before upcoming peak seasons. Each of the service owners should have a system audit ahead of time and find the breaking point of the system and be ready with appropriate fallback. 4. Perf / load testing to set correct infra. 5. Every system metrics review in terms of load and TPS. 6. Exponential backof retry. 7. Trace a request E2E. 8. Understanding the DB is a difficult scaling factor - immediate auto scaling the kubernetes pod is not always easy as it takes time to trigger the auto scaling. 9. Get the back of the envelope calculation done ahead of time and prescale upfront. 10. How important it is to make the database up. 11. How cache helps and understanding what to cache. 12. How plan B helps and how the fallback for crucial service APIs matters to provide a smooth experience. 13. Panic mode - Invisible to customers and activated personalized fallback. 14. How multi CDN helps to decide which traffic should go to which servers 15. Real engineering - cache offload best practices. 16. As everything comes with cost, so decide which CDN call should go to the server that eventually calls db and which one should utilize cache data. 17. Asynchronous processing during live matches. 18. Kafka - producer rate, consumer rate and decide partitions. 19. How ads get displayed and things happen behind the scenes, etc. Many thanks to Arpit Bhayani and Prachi Sharma for sharing such an insightful conversation! I can relate the same to my organisation practices when peak sale time comes to the eCommerce shopping sites. Check out the conversation here -

8

1 Comment