SQL AI Beta release

Writing SQL queries is often one of the first steps in data analysis. With our latest upgrade to Deepnote AI, it can now assist you in getting this essential task done much more easily. Simply click on the AI button in a SQL block and ask a question in plain language - Deepnote AI will interpret it and provide you with a suggested SQL query you can run immediately.

Watch this 2-minute demo to see SQL AI in action for yourself!

You can also use the AI button to help with editing an existing query or fix issues with errors you may encounter.

As with all AI features, the right context is key for accurate suggestions. Deepnote AI utilizes the content of your notebook along with the schema of your connected data warehouse. To ensure the AI is incorporating the most updated schema information, you may want to refresh the given integration’s schema. It might take a minute or two for the updated schema to propagate to Deepnote AI, especially if you are connecting to an integration from your Deepnote workspace for the first time.

Once that’s done, Deepnote AI will be able to take advantage of your schema structure to compose queries with the relevant table and column names. (It may take a few minutes after refreshing the schema to make this information available).

If you prefer to use SQL for data manipulation of Python variables, Deepnote AI can also assist you in that. The AI button is available in Dataframe SQL blocks as well, so you can ask for the AI’s help in writing SQL for any downstream filtering and aggregations.

We hope that SQL AI will make query writing a more efficient, smoother process for you, but as of now, this is a Beta release with some limitations to note.

• Schemas can get very large, sometimes including thousands of tables. Deepnote AI searches for the relevant parts, but it may not always come up with the right table/columns names for you. If you notice this pattern, try providing guidance in the notebook or in the prompt (e.g. mention in a text block to ‘always use table order_details for order attributes’). This kind of information can greatly help steer the AI to get the right answers for you. Check out our docs for more prompting tricks and tips.
• SQL AI is only available to assist you in one SQL block at a time. When you use Auto AI to generate multiple blocks for you, SQL blocks won’t be added.
• Supported integrations include BigQuery, Snowflake, PostgreSQL, Redshift, Athena and Clickhouse, MySQL, MariaDB and Microsoft SQL Server.

We are actively improving SQL AI to make the suggestions more accurate and relevant for you. Your feedback is crucial for us: please let us know if you encounter issues by clicking on the thumbs down button and leaving a note!

Be sure to check out our docs to learn more.

Pie charts, histograms & new blocks for more interactive apps

Pie charts

Visualization experts will tell you all about why you shouldn't use pie charts to present your data. But let’s be honest, the pie is a staple of dashboards and your stakeholders often expect them. We have good news: you can now easily create those pie charts in our native chart blocks! Simply select Pie chart in the Type selector and configure your slices with two clicks!

The new chart type comes with its own customization options under the Format tab. You can switch between absolute and relative views (switch Show as to ‘Percentage’); or change where you position the value labels in the Position dropdown. What’s more, you can easily turn your pie into a doughnut by adjusting the Center gap in your chart. Happy baking!

Histograms

We also added another chart type to the roster: histograms! Yes, you could already create histograms in our bar charts, but it was a bit too finicky a process and many of you requested a simpler way to create these visualizations. We listened and made it as easy as possible: just pick the new Histogram chartfrom the type selector and select a single column - that’s it! If you need to customize the chart, you can adjust the binning parameters by clicking on the BIN selector. Here’s to quicker basic data exploration!

New blocks types

Blocks are kind of a big deal in Deepnote and we just added not one, but 4 brand new block types so you can build more appealing and interactive Apps!

Text area input: a more spacious input block that can nicely accommodate multi-line texts.

File upload: this powerful input block enables your consumers to upload and process their own data in your Apps with ease.

Button: a customizable button that makes submitting input changes a lot clearer and easier for your App consumers.

Separator: a handy new text block type for better visual separation of content. Tip: you can also type three dashes ‘—-’ to insert a separator.

We hope these new building blocks will turn your Apps even more powerful and can’t wait to see what you will build with them!

Simplified hardware sidebar

We also made a small, but important to change to the environment configuration experience in your notebooks. Gone are the days when you had to hunt for your machine configuration and other environment-related options in a tucked away settings submenu: these often used controls are now always visible in the left side panel.

SQL auto formatting, always-on AI UI and prompt suggestions

Code formatting for SQL blocks

Instantly tidy up your SQL code using the new auto-formatting feature for SQL blocks.

Available through the command palette, block actions menu, or as a keyboard shortcut (option+shift+F for Mac orAlt+Shift+F Windows / Linux), the SQL formatter makes querying your data in Deepnote feel like second nature.

AI front and center, always

Deepnote AI is now immediately ready to assist at every step of your analyses in Deepnote. With the AI prompt box now always visible at the bottom of your notebook, you no longer have to hunt for the AI button to unlock the power of Deepnote AI.

This update to the AI UI is part of a series of changes we’ve added in recent weeks to make Deepnote an AI-first notebook, which brings us to one more AI update…

AI prompt suggestions

The power of an AI coding assistant is only as good as the prompt you give it. We’re no stranger to stumbling upon writers’ (or coders’) block during the prompting process, so we’ve introduced prompt suggestions to make the Deepnote AI experience even more seamless.

Whether you need fresh ideas during your data exploration process, a way of saving time and keystrokes, or just more assistance from Deepnote AI, prompt suggestions will have your back from beginning to end of your Deepnote projects.

Check out our updated docs to read more about the latest and greatest AI features!

Stronger GPU hardware and visual revamp of charts

More powerful machines now available

We’re welcoming a new, more powerful machine to our cloud-based hardware options. When navigating to the machines menu in the Environment pane, you’ll notice a new GPU hardware, which includes the heavy-duty graphics card Nvidia V100 offering 64 GB of RAM and 8 vCPUs.

This stronger machine is currently only available as a pay-as-you-go hardware, which enables uninterrupted execution of code in your most complex analyses, on your largest datasets.

A brand new aesthetic for chart blocks

Your Deepnote notebooks and apps now have a much more polished look and feel. Our latest visual update includes new color schemes for chart blocks, including new categorical and continuous color palettes.

In addition to new color palettes, you might also notice updated layouts, spacing and fonts applied to your charts, making for a sleeker visualization experience in Deepnote. With these visual changes, we’re setting the stage for even bigger changes to come to chart blocks soon—including new chart types and AI-powered charts, so stay tuned!

Faster apps and new AI UI

Lightning-fast apps

We’ve added some more improvements to the app experience that you won’t want to miss. Apps now stay active for longer, meaning you can step away, do your thing and pick back up where you left off without the executor shutting off the app. Now, the app executor keeps running until the user closes the app's browser window, or if the app has been idle for more than 10 minutes.

You’ll also start to notice Deepnote apps now load significantly faster when you turn on the “Allow reactivity” toggle in your app settings. With this new setting, your app will no longer execute all the contents from top to bottom with every input adjustment like it used to. Instead, only the contents that depend on your changed inputs will be recalculated, making for lightning-fast app interactions. Watch it in action in this video.

We’re launching this same reactivity in notebooks soon, so send us a note if you want to be part of the private beta!

AI front and center

Collaborating with Deepnote AI on your analyses is now a seamless experience thanks to a host of UI updates and new powerful interactions.

Convenient new shortcuts make accessing the new UI a breeze. Use cmd + shift + i to ask the AI for an explanation of any block of code, and cmd + shift + e to edit the code.

Intuitive prompting means your AI collaborator can guess your next move. The UI defaults to edit mode when you’re accessing it in a block with existing code, but generate mode in an empty block.

More space for your AI prompts. The new UI is now front and center so you can start writing your prompt right away, but you can still easily see your notebook contents behind the prompt window with the new Peek Behind UI toggle.

New powerful Auto AI interactions. When leveraging Auto AI to generate and run multiple blocks in your notebook, you now have new commands that enable you to iteratively fine-tune the AI’s output with just a push of a button:

• Run code allows you to check the results of the AI’s suggestions before you accept or reject them
• Regenerate gives you the power to restart AI generation with the same prompt if you aren’t happy with the AI’s first suggestion
• Delete allows you to reject the AI’s results and edit your prompt until the code is generated to your liking.

We hope you enjoy your faster apps and the enhanced AI experience, and stay tuned for more exciting updates to come!

New app building experience and Slack integration

Streamlined in-notebook app building

Calling all app builders: we have an update that will turbocharge the app creation process from within notebooks.

You can now control the visibility of blocks in your app directly from the notebook interface.

Hide/show in app: Clicking the disappearing computer icon will hide or show a block or its contents in your app, but will still be visible in your notebook. Blocks that are currently hidden in your app will appear as faded out in the notebook.

Select multiple blocks: Efficiently manage the visibility of multiple app blocks at the same time by using the multi-select feature available in notebooks. Simply hold SHIFT and click on neighboring blocks to hide multiple blocks’ output and/or code from your app.

Dynamic apps: Once you’ve configured your app exactly to your liking, the visibility settings you’ve set in your notebook will automatically come to life in the app view. Gone are the days of constant back-and-forth between notebook and app interfaces to share your data insights!

Slack integration

Conveniently view the status of your scheduled notebook runs from the comfort of your Slack workspaces with our new Slack integration.

This integration allows you to deliver notifications about your Deepnote analyses at desired checkpoints within your data workflows.

To get started with sending your scheduled notebook runs to Slack, check out the step-by-step instructions in our docs or try it out for yourself by duplicating this example notebook.

BigQuery schema browser improvements & more flexible AI copilot

Multi-project schema explorer for BigQuery

If you’re a power user of our BigQuery integration, you’ve probably taken advantage of the schema explorer to query data from multiple projects in your warehouse using Deepnote.

That process just became even easier with our new multi-project schema explorer for BigQuery, which gives you a high-level exploration of multiple projects at a time and the columns within them, all from one convenient side panel view within your notebook.

With a more unified view of all your BigQuery data, you’re now ready to tackle multiple projects with less set up time and context switching.

AI Copilot toggle

Maintain total control over the working environment within your notebook with the new AI Copilot toggle. If you’d prefer to kick off your code and queries without any AI assistance, easily disable Copilot with a flip of a switch.

This new feature is a persistent user setting, meaning once you turn it off, you disable it for yourself for all projects. Need to turn Copilot back on later on? Simply toggle it back on and it stays on for you.

Faster HTML cell outputs

Spend less time waiting for your charts to spin up and more time on the parts of your workflow that actually matter.

It’s no secret Deepnote supports your exploratory programming needs with the power of interactive visualizations, whether that’s through code or no-code chart blocks. If you prefer using code to build your visualizations through HTML-based libraries like Plotly, your plots will now load with lightning speeds.

We hope these updates bring you faster data exploration and workflows more tailored to your data needs in the new year. Rest assured, we have plenty more updates in store for you in 2024, so stay tuned!

Reduced machine prices & faster notebooks

Reduced machine prices

We’re giving the gift of a faster, cheaper Deepnote for the holidays.

As you may have already heard, starting December 1, we're slashing the pay-as-you-go rates across all our machines – making them more budget-friendly without any hidden terms. These new rates will be applied to all current and new paying workspaces going forward.

This means you can effortlessly upgrade to more powerful machines for all your data projects without dipping into your holiday gift budget!

Supercharged notebook loading

You may have already noticed your projects are loading way faster than before. This is no mistake—we’ve decreased the time from opening your Deepnote project to seeing the notebook contents by up to 10x, thanks to our new backend data loading system.

This will enable you to quickly dive into multiple projects across your workspace and seamlessly switch between them to ultimately be able to leverage Deepnote as a knowledge base.

Together, these new additions mean less loading time and more time for what’s important—your data work.

We hope you enjoy your faster notebooks on more powerful machines soon, and stay tuned for more exciting updates!

Improved AI code editing & fixing

Diff viewing for AI editing and fixing

We’re shaking things up with Deepnote’s AI code editing and error fixing workflow.

Auto AI is not just for generating code, but also for editing and fixing that generated code. Now with AI 2.0, changes made by the autonomous agent will be displayed in a diff viewer so that you can see what was added, deleted and updated, side-by-side with the original code.

The AI-generated content in the “new” side of the diff viewer is automatically written into your code block so that you can immediately see the impact of the AI’s change on your analysis. Change your mind? Just undo it with a click of a button using the new Done/Undo button.

Notebook variables as AI context

Auto AI has always had a deep understanding of your project context, including your content in your blocks, outputs and filenames. But now we’ve extended its awareness to also cover all the variables in your notebook. This will provide even more accurate suggestions, particularly in cases when the given variable has not already appeared in outputs. What does this mean for improvements to your coding workflows? No more “name ‘variable’ is not defined” errors.

With the AI’s new awareness of available DataFrame variables, Auto AI is now equipped with the metadata it needs to work with you in lockstep as a true collaborator.

Visual updates coming soon to a screen near you

You’ll be noticing some changes in Deepnote’s UI soon. We’ve been working meticulously to create consistent, beautiful UI throughout Deepnote to add a more polished and sleek feel to your experience. The most highly requested update? Dark mode. Stay tuned for a more official announcement soon!

Introducing: Fully autonomous AI

The ultimate AI-powered notebook has arrived.

We’ve been keeping this one under wraps for several months now, but we’re excited it’s finally here: a completely autonomous, self-sufficient virtual collaborator. How powerful is it?

Give your AI teammate a task and it will continue working until it completes it. It generates text and Python blocks, adapts to prior outputs, and fixes its own errors all in the same run. After the code is generated, it automatically executes the code for you, even while you’re working in other notebooks.

It's aware of your context from other blocks and variables in your notebook and files.

While it can operate completely independently, you still maintain control. Switch it off using the Auto AI toggle, or even stop it mid-run if you’d like. Of course, it’s built with collaboration in mind. Any other collaborators working in your notebook can see its progress the same way you can.

Read more in docs →