#propertyBasedTesting

SWE-bench asks: can an AI fix a bug it already knows about? We asked something harder: can an AI find bugs it has never been told about — using property-based testing and nothing but API docs? Introducing PBT-Bench 🧵

The benchmark also shows how agents fail differently. Baseline: tests aimed at the wrong invariant (59%) or too-specific assertions (32%). PBT: over-filtering inputs with assume() (31%) or targeting the wrong value range (31%). Different failure modes → different fixes.

📄 Paper: 💻 Code: 🤗 Dataset: 🌐 Website: #MachineLearning #SoftwareTesting #PropertyBasedTesting

Our VP of Engineering, Fernanda Andrade, spoke on property-based testing at @LambdaDays. Honored to have John Hughes, creator of QuickCheck in Haskell, in the audience. Are your projects inspired by QuickCheck? #PropertyBasedTesting #QuickCheck #Haskell

Testing your Java with @ApacheGroovy, Spock, JUnit5, Jacoco, Jqwik and Pitest: #groovylang #propertybasedtesting #jacoco #mutatingtesting #coverage /CC @_pitest @spockframework @junitteam @jqwiknet

Excited about our closing Keynote: @swannodette, a NYC–based developer and musician. David will talk about #functional relational programming in the context of generative #PropertyBasedTesting of identities and assets on the #blockchain. You can't miss it!

5 parts article series about property-based testing in Kotlin + Java using KotlinTest + JUnit. Thanks for sharing!! #kotlin #testing #propertybasedtesting #viewmodel #androiddev @d_rawers Maybe worth mentioning:

@gdg_sydney thanks for the opportunity to present at #devfest19 ♥️ I know it's late 😀 but here's a write-up of my #kotlin talk:

#AdventOfPBT Day 4 🎅📅 Let's try another way to test our algorithms with #PropertyBasedTesting and #fastcheck in #JavaScript 😊 Today's topic will be to cover: detectCycleInLinkedList Subject: All other subjects: Thread ⬇️

Two weeks till Ken Barclay talks us through 'Property Based Testing in #Kotlin, A tale of two libraries' #propertyBasedTesting #kug

Mercoledì abbiamo esplorato il #PropertyBasedTesting con Arialdo Martini🚀 Ci siamo chiesti: "Quanti test sono abbastanza test?" e abbiamo lavorato per decostruire vecchie abitudini, creando il nostro primo property test. Un bel workout per la mente💡 #TDD #PBT #devlife #techtips

Awesome, very well delivered talk and Q&A about #PropertyBasedTesting by @magdastozek 👏 Our @softwaremill team enjoys @scala_love today 😍 #Scala

#UppsIdidItAgain the next #atamVIE aka Night of the Test(Automation)Bus­ters takes place 18.Jan.2018 - sponsored by @IVM_at and s-ItSolutions - get your seat to watch @gasparnagy talk about #propertyBasedTesting

Dear Friends, I'll be sharing about #PropertyBasedTesting at #FOSSASIA Summit 2019: Plus, there are lots of interesting talks and workshops on free and #opensource software during the summit. Hope to see you there! :-)

Advent of Code 2020 in F# 🎄 Day 13 A quick intro to #propertybasedtesting. Playing with infinite sequences for part 1. Finally admitting defeat and looking up a spoiler for part 2 because I SUCK AT MATHS 😅 Still fun though! #adventofcode #fsharp

Let's experiment with #propertyBasedTesting (randomized tests) in #golang via in

We got Prof Kostis Sagonas from @UU_University @uppsalauni in Sweden Doing some comparisons between Unit Testing and Property-Based Testing. #UnitTesting #PropertyBasedTesting #IoTSecurityHack #SASUFWorkshop #SASUF #IoT #IoTSecurity

Thanks to all who checked out my #PropertyBasedTesting talk yesterday at #FOSSASIA Summit 2019 Presentation deck is now available on slideshare: #python #hypothesis #testing #bughunting #continuousintegration

Using FsCheck is a joy. The real feeling of having that safety net comes from when you deliberately create a bug to confirm your test is working and FsCheck comes back with the absolute perfect, minimal reproduction of that exactly repro.

For example, I've just been testing it to prove that optimistic concurrency checks have been implemented correctly in a system we're developing. Works like a charm. #fsharp #dotnet #propertybasedtesting #testing

Jak zaprząc do roboty bibliotekę do testowania tak żeby to ona wykrywała nam błędy o których nie wiemy? Zapraszam na moją prezentację o #PropertyBasedTesting na jutrzejszym spotkaniu @ZgJUG

Na @ZgJUG dzisiaj @magdastozek o Testowaniu opartym na właściwościach oraz @OlaQnysz o (Po)Wolnych Aplikacjach - same konkrety, kogo nie ma niech żałuje :)

@marcinstozek @ZgJUG @OlaQnysz Moje slajdy z wczorajszej prezentacji o #propertyBasedTesting :

.@dibblego got interested in Agile while he was, "Trying to find solutions to all the broken software out there." Read full interview: Register now to attend his workshop at #AgileIndia2020. #Agile #PropertyBasedTesting #Haskell #Scala #Csharp

🛰️ It is easy to consider #PropertyBasedTesting as yet another 🎲 #fuzzing technique. But 🐒 fast-check is not 🐼 @faker_js, it fulfills really different needs. Why? And why deterministic random in tests is key to success for your tests? 🧵

The key strength of property based testing and of 🐒 fast-check is that it can reduce failures to smaller ones. So instead of telling you "there is a failure in this MASSIVE input, it will report something smaller but failing too".

As a conclusion, #PropertyBasedTesting has been designed for tests, it does not replace fake generators and fake generators do not replace it. They fulfill two fully distinct targets 👋