Python Weekly (Issue 664 August 22 2024)

Python Weekly - Issue 664

August 22, 2024

Python Weekly

Welcome to issue 664 of Python Weekly. Let's get straight to the links this week.

From Our Sponsor 

A weekly newsletter featuring the best hand curated news, articles, tutorials, talks, tools and libraries etc for programmers.

Articles, Tutorials and Talks

Every now and then you hear outrageous claims such as “Python has no preprocessor”. This is simply not true. In fact, Python has the best preprocessor of all languages - it quite literally allows us to do whatever we want, and a lot more. It’s just a little tricky to (ab)use.

The video covers setting up a Lang chain for custom data sets using a variety of tools like Python, Jupyter, and OpenAI, demonstrating API creation, embedding models, and vector database integration. It also discusses implementing rate limiting in a FastAPI application and setting up agents for querying and handling data.

The article discusses the complexities and challenges of building a custom query language, highlighting key considerations such as syntax design, parsing, and execution. It provides insights and practical tips for developers looking to create or improve their own query languages.

The post discusses the evolution of Python packaging tools, highlighting the recent advancements in uv and its potential to become the dominant tool in the space. 

The video explains how to code a visual language model from scratch using PyTorch, covering topics such as vision transformers, contrastive learning, and language models. It provides a detailed walkthrough of implementing various components, including the vision encoder, language model, and how to combine image and text embeddings, with explanations of key concepts like attention mechanisms and normalization.

The article demonstrates how to integrate Google's Gemma 2 language model into a Dataflow pipeline for real-time sentiment analysis and response generation in customer support chats. It provides a practical example of using Gemma to process streaming data, including code snippets for creating prompts, running inference, and handling model outputs within a scalable data processing framework.

The post explains how to extend Scrapy to save crawl statistics directly into a PostgreSQL database, detailing the implementation process and configuration needed. It provides a guide for integrating Scrapy with PostgreSQL to enhance data management and analysis.

Interesting Projects, Tools and Libraries

This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems.

Data annotation toolbox supports image, audio and video data.

Making asyncio less painful in ipython.

Off-grid, resilient mesh communication with strong encryption, forward secrecy and extreme privacy.

Qik is a command runner that understands the import graph, allowing you to cache commands and only run the things that matter. Can dramatically speed up CI/dev in large monorepos.

Pare is the easiest way to deploy Python Lambdas alongside your primary web application.

A Lightweight Library for LLM I/O.

Upcoming Events and Webinars

There will be following talks

  • Zero Code Change GPU-Accelerated Data Science in Python

  • Scalene to keep your code fast enough

There will be following talks

  • The mechanics of matplotlib and how one could embed charts into various outputs

  • ReportLab PDF Toolkit

There will be a workshop, Build a Data Science Portfolio that Gets You Noticed.

There will be following talks

  • Payments Data Science at Uber

  • Exploring ESG performance in job ads through AI and Data Science

  • Polar Expedition: Speed and Developer Experience Insights of transitioning ML pipelines to Polars

There will be following talks

  • Streamlining Python Development: A Practical Approach to CI/CD with GitHub Actions

  • Fast and user-friendly GLMs with glum 3

There will be a talk, AI Beyond the hype: Applying Large Language Models and Agentic AI to simplify knowledge curation and retrieval.

Our Other Newsletters

 - A free weekly newsletter for programmers.

- A free weekly newsletter for entrepreneurs featuring best curated content, must read articles, how to guides, tips and tricks, resources, events and more.