WandB Reports

Reports published on Fully Connected

Building an AI teacher’s assistant using LlamaIndex and Groq

nlp

llm

llmops

weave

prompt

rag

Today, we’re going to leverage a RAG pipeline to create an AI TA capable of helping out with grading, questions about a class syllabus, and more.

Brain Tumor Segmentation using MONAI and WandB

computervision

deeplearning

diffusion

huggingface

pixart

prompt

Supercharging your Deep Learning workflows for Medical Imaging using MonAI and Weights & Biases.

PIXART-α: A Diffusion Transformer Model for Text-to-Image Generation

computervision

deeplearning

monai

segmentation

medical

This article provides a short tutorial on how to run experiments with Pixart-α — the new transformer-based Diffusion model for generating photorealistic images from text.

November 29, 2023

A Guide to Prompt Engineering for Stable Diffusion

computervision

deeplearning

diffusion

huggingface

stable-diffusion

prompt

A comprehensive guide to prompt engineering for generating images using Stable Diffusion, HuggingFace Diffusers and Weights & Biases.

October 24, 2023

Object Detection using YOLOv8: An End-to-End Workflow

deeplearning

pytorch

computervision

object-detection

yolo

A comprehensive guide to building an object detection workflow using Ultralytics YOLOv8 and Weights & Biases.

September 25, 2023

A Guide to Generating Music using AudioCraft

deeplearning

generative

2-minute-papers

diffusion

audio

This article provides a comprehensive guide to using state-of-the-art music and audio generation models using AudioCraft from Meta, along with Weights & Biases. This article provides a comprehensive guide to using state-of-the-art music and audio generation models using AudioCraft from Meta, along with Weights & Biases.

September 13, 2023

A Guide to Using Stable Diffusion XL with HuggingFace Diffusers and W&B

computervision

deeplearning

diffusion

huggingface

stable-diffusion

A comprehensive guide to using Stable Diffusion XL (SDXL) for generating high-quality images using HuggingFace Diffusers and managing experiments with Weights & Biases.

August 21, 2023

Supercharging Ultralytics with Weights & Biases

deeplearning

pytorch

computervision

object-detection

A guide on using Weights & Biases with Ultralytics workflows for computer vision models.

XLA Compatibility of Vision Models in Keras

deeplearning

tensorflow

keras

computervision

xla

A set of comprehensive benchmarks around XLA compatibility of computer vision models implemented in Keras.

Sayak Paul, GeekyRakshit, Ayush Thakur

Multi-Task Learning as a Bargaining Game

multi-task-learning

deeplearning

pytorch

In this article, we explore gradient combination in multi-task learning (MTL) as a cooperative bargaining game, and discuss Nash MTL — a novel approach — in detail.

DeepFloydAI: A New Breakthrough in Text-Guided Image Generation

computervision

deeplearning

generative

diffusion

huggingface

In this article, we explore DeepFloydAI — an AI Research Band which is working with StabilityAI to make AI open again.

Paella: Fast Text-Conditional Image Generation

computervision

deeplearning

generative

In this article, we explore the paper “Fast Text-Conditional Discrete Denoising on Vector-Quantized Latent Spaces” which introduces Paella, a novel text-to-image model.

Fine-Tuning Stable Diffusion Using Dreambooth in Keras

computervision

deeplearning

generative

diffusion

stable-diffusion

keras

tensorflow

In this article, we quickly teach Stable Diffusion new visual concepts using Dreambooth in Keras, to produce fully-novel photorealistic images of a given subject.

Low-Light Image Enhancement: Lighting up Images in the Deep Learning Era

deeplearning

tensorflow

keras

computervision

In this article, we explore some deep learning techniques for low-light image enhancement, so that you can enhance images taken under sub-optimal conditions.

GeekyRakshit, Saurav Maheshkar, Samarendra Dash, Aritra Roy Gosthipaty

Digging Into the ShapeNetCore Dataset

computervision

deeplearning

pytorch

geometric-deeplearning

point-cloud

In this article, we dive into the ShapeNetCore Dataset for the classification and segmentation of point cloud data and explore how to use it using Weights & Biases.

January 20, 2023

Point Cloud Segmentation Using Dynamic Graph CNNs

computervision

deeplearning

pytorch

geometric-deeplearning

point-cloud

In this article, we explore a simple point cloud segmentation pipeline using Dynamic Graph CNNs, implemented using PyTorch Geometric along with Weights & Biases.

January 18, 2023

Point Cloud Classification Using PyTorch Geometric

computervision

deeplearning

pytorch

geometric-deeplearning

point-cloud

In this article, we explore how to classify point cloud data from 3D CAD Models, implementing the PointNet++ architecture and using PyTorch Geometric and W&B.

January 17, 2023

Unconditional Image Generation Using HuggingFace Diffusers

computervision

deeplearning

diffusion

huggingface

In this article, we explore how to train unconditional image generation models using HuggingFace Diffusers and we will track these experiments and compare the results usingWeights & Biases.

January 17, 2023

Variable Bitrate Neural Fields: Create Fast Approximations of 3D Scenes

computervision

deeplearning

nerf

2-minute-papers

This article explores creating accurate, fast approximations of complex 3D scenes with a low memory footprint, as outlined in Variable Bitrate Neural Fields.

December 3, 2022

Hazy Image Restoration Using Keras

deeplearning

tensorflow

keras

computervision

An introduction to building an Image Restoration model using Tensorflow, Keras, and Weights & Biases.

November 18, 2022

Advanced Tensorboard Features: Tensorflow Debugger

deeplearning

tensorboard

tensorflow

keras

An introduction to Machine Learning workflows written in Tensorflow using the Tensorboard Debugger.

November 11, 2022

Advanced Tensorboard Features: Graph Dashboard

deeplearning

tensorboard

An introduction to exploring Computation Graphs of our Machine Learning workflows with Tensorboard.

November 11, 2022

Object Detection for Autonomous Vehicles (A Step-by-Step Guide)

computervision

deeplearning

object-detection

yolo

Digging into object detection and perception for autonomous vehicles using YOLOv5 and Weights & Biases.

September 30, 2022

Training Semantic Segmentation Models for Autonomous Vehicles (A Step-by-Step Guide)

computervision

deeplearning

fastai

segmentation

A short tutorial on leveraging Weights & Biases to train a semantic segmentation model for autonomous vehicles.

September 30, 2022

Improving Generative Images with Instructions: Prompt-to-Prompt Image Editing with Cross Attention Control

computervision

deeplearning

generative

diffusion

stable-diffusion

2-minute-papers

A primer on text-driven image editing for large-scale text-based image synthesis models like Stable Diffusion & Imagen.

September 29, 2022

Building Diverse Skillsets for Video Game Characters With Adversarial Skill Embeddings

deeplearning

reinforcement-learning

2-minute-papers

In this article, we explore using large-scale reusable adversarial skill embeddings for physically simulated characters.

Robotic Telekinesis in the Wild

computervision

deeplearning

robotics

2-minute-papers

In this article, we teach a robotic hand imitator by watching humans on Youtube to enable any operator in the wild with only a single uncalibrated color camera.

Digging Into StyleGAN-NADA for CLIP-Guided Domain Adaptation

computervision

deeplearning

generative

2-minute-papers

In this article, we take a deep dive into how StyleGAN-NADA achieved the task of CLIP-guided domain adaptation and explore how we can use the model itself.

Modern Evolution Strategies for Creativity

computervision

deeplearning

generative

jax

In this article, we revisit evolutionary strategy algorithms for computational creativity and look at how they improve quality and efficiency in generating art.

Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields

computervision

deeplearning

nerf

In this article, we explore how to achieve photorealistic rendering of large unbounded 3D scenes from novel camera angles while preserving fine-grained details.

Extracting Triangular 3D Models, Materials, and Lighting From Images

deeplearning

graphics

2-minute-papers

In this article, we’ll explore a novel and efficient approach for joint optimization of topology, materials, and lighting from multi-view image observations.

Barbershop: Hair Transfer with GAN-Based Image Compositing Using Segmentation Masks

computervision

deeplearning

generative

2-minute-papers

A novel GAN-based optimization method for photo-realistic hairstyle transfer.

Working with FuncTorch: An Introduction

deeplearning

pytorch

jax

Working with JAX-like composable function transforms in PyTorch.

Implementing NeRF in JAX

computervision

deeplearning

nerf

jax

This article uses JAX to create a minimal implementation of 3D volumetric rendering of scenes represented by Neural Radiance Fields, using W&B to track all metrics.

Block-NeRF: Scalable Large Scene Neural View Synthesis

computervision

deeplearning

nerf

2-minute-papers

Representing large city-scale environments spanning multiple blocks using Neural Radiance Fields.

Learning Robust Perceptive Locomotion for Quadrupedal Robots in the Wild

computervision

deeplearning

reinforcement-learning

robotics

2-minute-papers

Or, teaching four-legged robots to walk in the real world.

PoE-GAN: Generating Images from Multi-Modal Inputs

computervision

deeplearning

generative

2-minute-papers

PoE-GAN is a recent, fascinating paper where the authors generate images from multiple inputs like text, style, segmentation, and sketch. We dig into the architecture, the underlying math, and of course, generate some images along the way.

February 25, 2022