Pinned Tweet
My first article on Apache Spark vs. cloud native SQL engines #ApacheSpark #SQL @databricks: medium.com/@franz.woeller…
1
0
3
MansenPansen retweeted
TIL about Apache DafaFusion Comet. @Apple has replaced @ApacheSpark's guts with @ApacheArrow DataFusion. And they're donating it. 🤯
github.com/apache/arrow-d…
This is an alternative to @MetaOpenSource's Velox Spark implementation.
facebookincubator.github.io/velox/spark_fu…
/ht @philippemnoel
github.com/apache/arrow-d…
This is an alternative to @MetaOpenSource's Velox Spark implementation.
facebookincubator.github.io/velox/spark_fu…
/ht @philippemnoel
5
49
247
42,751
MansenPansen retweeted
ipywidgets are a great tool with huge positive impact. But at the moment, the project is like a moving ship without a captain. It's public infrastructure that requires maintenance, and it needs financial support to be sustainable. A thread.
2
23
54
8,361
MansenPansen retweeted
Take a look at @MansenPansen comparing Apache Spark and cloud-native SQL engines at #EuroPython2023, now on YouTube: youtu.be/vHNOLfUDBZQ 🐍. Don't miss out!
0
1
2
808
MansenPansen retweeted
I started a podcast with @pyblogsal about #Python internals. We call it "core.py", hope you like it!
The first episode is about the core sprint in Brno where we spent last week.
podcasters.spotify.com/pod/show/corepy
The first episode is about the core sprint in Brno where we spent last week.
podcasters.spotify.com/pod/show/corepy
14
39
192
29,236
MansenPansen retweeted
I think we can call it shut on 'Open' AI: the 98 page paper introducing GPT-4 proudly declares that they're disclosing *nothing* about the contents of their training set.
![This report focuses on the capabilities, limitations, and safety properties of GPT-4. GPT-4 is a
Transformer-style model [33] pre-trained to predict the next token in a document, using both publicly
available data (such as internet data) and data licensed from third-party providers. The model was
then fine-tuned using Reinforcement Learning from Human Feedback (RLHF) [34]. Given both
the competitive landscape and the safety implications of large-scale models like GPT-4, this report
contains no further details about the architecture (including model size), hardware, training compute,
dataset construction, training method, or similar.
We are committed to independent auditing of our technologies, and shared some initial steps and
ideas in this area in the system card accompanying this release.2 We plan to make further technical
details available to additional third parties who can advise us on how to weigh the competitive and
safety considerations above against the scientific value of fur](/pic/orig/media%2FFrMlVuNXsBsvq75.jpg)
82
1,124
5,805
1,425,426
MansenPansen retweeted
URGENT: If you use pydantic or @tiangolo's FastAPI and/or want to use them in the future, you need to read this:
github.com/samuelcolvin/p…
github.com/samuelcolvin/p…
8
159
430
MansenPansen retweeted
Python educators and users: I have been working on improving SyntaxError messages in CPython lately. What error (only *SyntaxErrors* for now 😅) messages you or your students have struggle with? Which ones you think we should improve? 🤔 (Pls RT to help reaching more people 🙏).
37
188
241
MansenPansen retweeted
We find no evidence that the formation of "transcriptional condensates" amplifies gene expression or increases transcription activation tinyurl.com/y56tof9c
8
171
560
MansenPansen retweeted
Interactive analysis needs theories of inference statmodeling.stat.columbia.edu/2020/10/23/int…
0
5
15
MansenPansen retweeted
We have just released @ApacheArrow 2.0.0 with 511 commits from 81 different contributors, read more:
arrow.apache.org/blog/2020/10/2…
arrow.apache.org/blog/2020/10/2…
0
28
96
MansenPansen retweeted
Video of my 14-minute keynote from the #RaySummit about the need to improve our single-node computational foundations in addition to making it easier to do distributed computing in Python
"Scalable Python We Can Afford"
youtube.com/watch?v=TflnJK…
"Scalable Python We Can Afford"
youtube.com/watch?v=TflnJK…
3
38
125
MansenPansen retweeted
Today is release day! We're announcing a new initiative to tackle the fragmentation in Python array/tensor and dataframe libraries: data-apis.org/blog/announcin…. Major challenge, with hopefully major benefits for the whole ecosystem.
14
157
386