So, you don’t want to go down the whole ETL (Extract Transform Load) route in order to access external data from your Microsoft SQL server?

Okay, what about MS SQL Polybase?

Take a listen to learn more and to see how you could access external data using T-SQL without having to ETL the data into your environment - leaving the external data where it is.

For me personally, the CSV option via say Amazon S3 buckets, Azure Storage is an interesting option as well as being able to query SAP HANA data and possibly even joining to SQL database data ;)

Here are some links to delve deeper if you so wish:

What is Polybase / Data Virtualization

Virtualize a CSV file into SQL

Accessing generic ODBC sources

Accessing SAP HANA data via Polybase

We all love JSON data, don’t we?

Well, unless you are working with JSON directly from say C# or whatever flavour of language you use, working with JSON data can be a challenge sometimes. Sure, if you are in native JavaScript land or one of the many plethora of JS frameworks, then “JavaScript Object Notation” (aka JSON) isn’t much use!

jq is a really neat command line JSON processor. Written in portable C, it seems to be available anywhere… and I mean anywhere! even the old Solaris (Sun Microsystems).

There is a great tutorial too!

Thanks to my good friend Tim Abell for suggesting this one!

Maybe check out Tim’s podcast too!

Okay, so just to be clear, DAB (Data API Builder) doesn’t simply expose your database ;) better make that clear!

However, when you need to build the key components to work with a database i.e. CRUD (Create, Read, Update and Delete), then you can of course use whatever method you like. But what if an API can be delivered for you? better still you can have REST or GraphQL or both!

Oh, and yes, it works with MS-SQL databases, Azure SQL but also noSQL databases and MySQL/PostgresQL too! :)

Anyway, take a listen to learn more.

Links from the podcast:

Data API Builder on Github

More in-depth MS Learn docs

What is the most popular database engine around?

Well, a good contender is SQLite - it has been around for years and is in pretty much every device! yes, inside your Android and iPhone as well as many others including the web browser (I have only looked at using via WASM BTW!).

SQLite is a flat file based SQL database with some rather nifty features (including functions, CTE and JSON support via plugins). It has an amazing ecosystem and has been around for a long, long time.

SQLite cloud is taking the next step - SQLite, well, in the cloud! multi-region support, local/cloud sync and much more!

Take a listen to find out more.

Links below from the show:

SQLite official docs

SQLite CTE support

SQLite JSON support

SQLite Cloud!

Well, perhaps this should have been one for my other podcast (just experimenting with “What’s going on with…”) although, here it is trying to fit within just five minutes - not a chance!! :)

Okay, so a ramble it is! Covering some AI investment observations as well as AI hardware - the brutal world of trying something new and attempting to break ground into new markets, even if you don’t need them ;)

I reference a couple of links which are below:

The investment video I mentioned is here

The limitless AI site which includes the AI hardware pendant (where I would bet my AI hardware money) is here

Okay, if you managed to get through the whole podcast, I should honestly buy you a coffee or beer or whatever you care to enjoy!

I promise I will not make too many of these weekend rambles! back to normal JFM’s now :)

Oh, and if you want to understand/take a look at Nvidia GeForce Cloud Gaming, the link is here (I cannot believe I didn’t understand the whole proposition of this!)

I think I covered some basics about Docker dev containers a while ago when it was new’ish in beta.

Recently, I have been playing more and more with dev containers to save cluttering up my local machine and being able to be truly portable. I can take my dev container with me :) Windows, Mac, Linux - all works the same.

What is really fun is being able to say develop dotnet with SQL Server within a dev container, and have that same experience across any platform - including GitHub Codespaces - essentially developing fully in that infamous cloud! Might have to revisit a Codespace episode in the future!

But for now, enjoy, and here are some links to get you started if you wish to do so:

Docker Desktop - Windows, Mac, Linux, Palm Pilot

Dev Containers

As a bonus link, test containers! a clean test environment whenever you need it :)

Test Containers

GitHub Copilot is great, you do have to pay and it integrates nicely with VSCode and Visual Studio but what if there was a generic AI code assistant that is free to use and you can use it anywhere (not on the moon I am guessing)?

Codeium is the tool we are talking about.

It has a lovely free account that is pretty feature rich and you can use it all over the place! in your favourite IDE/text editor and even as a browser extension :)

Codeium also have trained their own models - no reliance on OpenAI or other API’s.

Well, it was Microsoft build conference recently and although there were some interesting announcements most were, of course, AI and Copilot related.

I have to say though, the new ARM based Windows “Copilot + PC’s” (my goodness, they need a better name!) do look rather interesting!

New Windows 11 File Explorer - 7-zip/TAR and built in GIT source control

Windows Copilot + PCs

Copilot runtime and library (local “SLM” small language models)

Until next time, take care!

Well, moving single pieces of data from one system to other systems isn’t too complicated. What happens when you need to move batches of data?

This is an old problem and an older scenario for sure - nothing that new here!

Perhaps, just tweaking how you might approach staging data, might help. That is what I am talking about today :)

Well, Tim Abel returns!

My good friend Tim (see the link above for more about him!) kindly joined me to discuss software testing - specifically outside in testing!

This podcast came about after I had listened to Tim’s podcast episode, and this spurred me on to ask a few questions! (well, three actually!)

Since Tim is a contract developer/team lead type of person, he has some wonderful experience working with many teams, and especially larger teams.

For someone like me, who isn’t a real developer these days, I wanted to try to understand where software testing is at these days. I remember doing some TDD (test driven development) and E2E (end to end) testing with some projects in the past, but these days I don’t get the exposure of larger scale software testing principles. It does seem things have moved on quite a bit!

Tim has a great approach about outside in testing from a user perspective. Please check out his full episode (above link) as it is well worth the listen!

Until next time, cheery bye!