March 25, 2024
interesting post on governance
This short post on the AI Act - https://joanna-bryson.blogspot.com/2024/02/2024-brief-overview-on-llm-foundation.html is worth a read. The author Joanna Bryson is brilliant. My main takeaways from the post are the following: • Framing the GDPR was a huge win for tech companies in the US • I softly disagree that these tools cannot be us...
Read more
Read more
February 16, 2024
Silverchair AI lab
Silver hair have announced an AI lab - https://www.silverchair.com/news/ai-lab-launches/, this is good news, and the kinds capabilities they are exploring - RAG search, summarisation, chat, are in may ways the low hanging fruit in this sector (not easy by any means, but the obvious areas to apply the technology). I think capabilities r...
Read more
Read more
February 16, 2024
Staying optimistic.
The post below is a really nice meditation on t# Staying optimistic. The post below is a really nice meditation on technology, change, and perspective. It also give a nice view on rough edges of products and gives a shoutout to the poem clock here. Overpromising and Stumbling Bambis This is a reflection (in part) of the broader culture...
Read more
Read more
February 11, 2024
AI clock
Matt Webb has made an AI powered clock that tells the time by generating a new poem every minute. What an awesome idea, an idea that I’ve seen this idea evolve over the last year, and last week he launched it on Kickstarter. This is the kind of thing that couldn’t have existed a few years ago, and now it can. Even though this small thi...
Read more
Read more
January 22, 2024
Links, and thoughts - week 3, 2024.
This is a delightful article about a physicist who collects interesting phenomena. It reminded me a little of the story of Richard Feynman getting back into physics after playing around with wobbling plates. Read the article here This is a shocking story about the normalisation of low level police corruption. I guess I’m linking to it ...
Read more
Read more
January 12, 2024
Reading - 2024 - Book 1 - The System of the World.
I’m trying to do a bit of reading of a book every day in 2024. I’ve decided to give up on the piano for this year, and reduce my focus to reading, and getting fitter. The first book I completed in 2024 was a re-read of The System of the World, by Neil Stephenson. I read it a few years ago, and had re-read the other two volumes of the t...
Read more
Read more
January 12, 2024
Interesting reads, and some thoughts, - week 2 - 2024
Linked Text: Interesting reads, and some thoughts, - week 2 - 2024 On the back of Matt Webb’s post - interconnected.org - I’ve started moving my reading over to RSS. As a result, I’m getting far more coverage of interesting things, at what feels far less effort than before. Here are a bunch of interesting things from the last week. Aff...
Read more
Read more
January 12, 2024
Have we seen the end of growth for publishing hyper scalers?
About four years ago I started paying attention to MDPI on the back of starting to look at Walt Crawfords amazing annual Open Access reports. (https://waltcrawford.name/goaj.html). The rate of revenue growth was astonishing, and over the next few years it continues. I truly thought at the time that maybe the existing journal model was ...
Read more
Read more
January 10, 2024
Here are a couple of useful reads to kick off 2024 with GenAI.
Ethan Mollick remains a key writer, giving perspective on what to expect in 2024: https://www.oneusefulthing.org/p/signs-and-portents • GenAI is already positively impacting work, with significant productivity gains (improvements of tens of percentage points). • Interestingly, many companies are either ignoring it or trying to use it a...
Read more
Read more
January 7, 2024
Weekly Links, some thoughts - week 1 - 2024.
Here are some things that I read over the last few weeks that I found interesting, or that I learned something from. Benedict Evan’s latest newsletter: https://newsletters.feedbinusercontent.com/de8/de8e11d8b69e568a52963c89d86e8b3d3ed837c9.html](https://newsletters.feedbinusercontent.com/de8/de8e11d8b69e568a52963c89d86e8b3d3ed837c9.htm...
Read more
Read more
January 2, 2024
We are going to need new architectures for the web.
From Simon Willison https://simonwillison.net/2023/Dec/19/facebook-is-being-overrun/ I picked up the link to this article: https://www.404media.co/facebook-is-being-overrun-with-stolen-ai-generated-images-that-people-think-are-real/ People are using image generation tools to farm the generation of 1000s of fake variants of mildly viral...
Read more
Read more
January 2, 2024
Some great advice on working with LLMs
Cross posting this blog - https://towardsdatascience.com/classifying-source-code-using-llms-what-and-how-f04c7dbcba9b It’s chock full of great advice on using LLMs. The task they worked on was determining if some given code was malicious. Some key advice: - running an LLM is expensive, check if another method might work for you. - LLMs...
Read more
Read more
December 25, 2023
My Climbing Year in Review - 2023
I had to wrap up my climbing year a bit early. On Thursday, just over a week ago, I injured my left ring finger’s FDP (long finger flexor tendon). It’s a moderate injury; recovery should take six to ten weeks, maybe less, but it’s serious enough for me to stop climbing ahead of our Christmas trip to go skiing. In spite of this setback ...
Read more
Read more
December 23, 2023
Some interesting facts to close out 2023.
This is a great list of factoids. https://snippet.finance/52-snippets-from-2023/ Here are my favourites, and what I think about them. Global inequality is reducing. This goes against my intuition, which tells me I remain have strong biases about how the world works and the current state of the world 37% of the worlds population has nev...
Read more
Read more
December 21, 2023
Interesting LLM Papers - December 2023
Some interesting LLM papers This is my take on papers from Davis Blaclock (https://dblalock.substack.com). This paper uses an LLM to rank response from a fine tuning run on a small model (7B parameters) to get it to perform in a more aligned way than a large model (70B) that has been fine tuned using RLHF. This is important because LLM...
Read more
Read more
December 21, 2023
AI and scholarly publishing - language assistance
Anastasia Toynbee from the Royal Society of Chemistry gave a great presentation a few weeks ago on how RSC are using machine translation to help authors who have English as a second language. There is a huge language burden for ESL authors, and she covered some of the stark data in her talk. Remember, talent is evenly distributed in th...
Read more
Read more
December 1, 2023
Decision making - some tips on how to get better at it.
This week our data and technology department had a workshop looking at how to be more decisive, led by the fantastic Claire Holmes. Going away from the meeting we have asked each team to pick two techniques to apply over the next 12 weeks, and then to report back on whether they were effective. It will be interesting to see where we la...
Read more
Read more
November 26, 2023
In our time - Einstein
Episode link https://www.bbc.co.uk/programmes/m001qdx1 Episode rating B+/A- I was fairly familiar with Einstein’s life, having had a fascination with the birth of modern physics for some time, but even still I learnt a few new things about him from this episode. I’d forgotten quite how long he had worked in obscurity as a parent attorn...
Read more
Read more
November 26, 2023
In our time, the Ramayana
Episode link https://www.bbc.co.uk/programmes/m001jst2 My recollected rating: A I really enjoyed this episode, and basically learnt all about the epic, but I have now mostly forgotten the details. I Got GPT to summarise the work again for me, and what I recall from the episode is a good analysis of the role and tribulations of Sita in ...
Read more
Read more
November 18, 2023
In our time - the chartists.
Episode link - https://www.bbc.co.uk/programmes/m001hx7n My rating - A- The chartists were a social movement in England that ran from around the 1830s to the late 1860s. It was a mass movement in search of political reform that would rebalance power in favour of the masses. As such it can be described as a social movement. Gatherings o...
Read more
Read more
November 18, 2023
In our time Paul Erdos
Episode link: https://www.bbc.co.uk/programmes/m001jc68 My rating: B- I learnt hardly anything new in this episode. The book - the man who loved only numbers - https://www.amazon.co.uk/Man-Who-Loved-Only-Numbers/dp/1857028295 is a much much better guide to the man. Having read that book I was excited about this episode, and was saving ...
Read more
Read more
November 17, 2023
GPT gets a conscience
I asked for a summary of the following paper: https://www.embopress.org/doi/full/10.15252/embr.201949472 ( The troubles with peer review for allocating research funding ) The command I used was: llm -m gpt-4-turbo -s "write an abstract for this paper, and give me the key findings in 10 bullet points" < funding-revew.txt With this comma...
Read more
Read more
November 9, 2023
magic, the command line, and large language models
Earlier this week I gave a talk about some of my current thinking about generative AI. One of the points I made is that while these tools have tremendous power, we are still scrambling around looking for the best ways to invoke that power. This reminded me of the command line. With the command line, you need to know the right incantati...
Read more
Read more
November 8, 2023
The difference between OpenAI’s Assistants, GPTs, and system prompts.
OpenAI made a ton of announcements earlier this week. As Benedict Evans pointed out, they are driving hard for the platform play. As expected, their models are becoming faster, more capable, and cheaper, with much longer context windows to boot. I fully expect this drive to continue for quite a while, as there remains a ton of headroom...
Read more
Read more
November 7, 2023
What are large companies saying about the future of copyright?
This article in The Verge is a good overview of responses from large tech companies to the US copyright office on questions around what the future of copyright should be in terms of regulation of AIs use of copyrighted material. The responses are very predictable. Mostly they argue that there should be no limits on what these AIs shoul...
Read more
Read more
October 31, 2023
Some thoughts on Futurepub - October 2023
I attended FuturePub last night, actually, I also spoke at it too. I love these events, I've attended a ton of them over the years, and last night's was in association with AI fringe, so there was a nice ad-mixture of different communities, and I got to chat to some folk that I wouldn't otherwise have met. A really good event, many tha...
Read more
Read more
October 30, 2023
Implementing AI Governance
On Monday the 30th of October I’m taking part in a FuturePub - AI and Research event. I’m going to be leading an open discussion on the topic of implementing AI Governance. EventBrite page with some more details. I put in the proposal when I saw the event pop up for a few reasons, the most direct one being that at BMJ we have implement...
Read more
Read more
October 24, 2023
Three interesting Machine Learning Papers - Sept 2023
I follow a monthly roundup of Machine Learning papers by Davis Blalock. https://dblalock.github.io/about/. It's a fantastic way to keep up with where the focus of the research community is, even at a very high level. You can catch it here: https://dblalock.substack.com/ I'd say the trends I've been seeing tend to be around areas such a...
Read more
Read more
October 16, 2023
Demystifying AI in the workplace
Last week I took part in an internal discussion with the CIO Carolyn Brown from the BMA where we talked all things AI, and how we think about its possible impact on the workplace. I think we had about 120 folk listen in, and we recorded the session in case anyone wants to catchup. The discussion was nicely moderated by Gordon Fletcher,...
Read more
Read more
August 15, 2023
Two perspectives on how transformative LLMs will be.
Gary Marcus writes persuasively that markets are massively over pricing LLMs, and this could lead to some very bad decision making in the near term - https://garymarcus.substack.com/p/what-if-generative-ai-turned-out. He writes that if the US gets into an AI “war” with China things could get hairy, But what has me worried right now is ...
Read more
Read more
See more posts »