You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-28 - 14:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Tue Apr 28, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3514263995347,4cyclictest3659078-21latency_hist21:30:011
3514263994843,4cyclictest3679863-21gpgv21:50:001
3514266994744,2cyclictest3685002-21fwupd21:52:282
3514266994133,6cyclictest3763807-21latency_hist23:10:002
3514270993927,10cyclictest3653087-21ntpq21:20:213
3514266993934,3cyclictest3779894-21kworker/u8:3+flush-259:023:35:012
3514261993932,5cyclictest3825399-21ntpq00:05:220
3514270993832,4cyclictest3711450-21latency_hist22:20:013
3514261993830,6cyclictest3590959-21ntpq20:20:210
3514261993631,3cyclictest3602772-21/usr/sbin/munin20:35:130
3514266993531,3cyclictest3679138-21kworker/u8:1+flush-259:022:45:252
3514266993529,4cyclictest3643641-21latency_hist21:15:012
3514261993531,3cyclictest3617577-21kworker/u8:0+events_unbound21:10:230
3514263993429,3cyclictest252-21systemd-journal22:02:201
351426199340,32cyclictest1-21systemd21:51:440
3514270993326,5cyclictest3539066-21ntpq19:30:203
3514266993327,4cyclictest3752253-21ntpq22:55:222
3514266993327,4cyclictest3617577-21kworker/u8:0+flush-259:021:45:182
3514263993329,3cyclictest3602799-21apt-get20:35:101
3514261993326,5cyclictest3841637-21latency_hist00:25:010
3514261993326,5cyclictest3554434-21ntpq19:45:210
3514266993226,4cyclictest3701189-21kworker/u8:0+flush-259:000:20:152
3514266993225,5cyclictest3726068-21ntpq22:30:212
3514263993228,3cyclictest3701189-21kworker/u8:0+flush-259:000:10:171
3514261993228,3cyclictest3617577-21kworker/u8:0+events_unbound21:10:010
3514261993227,4cyclictest3701189-21kworker/u8:0+flush-259:022:20:160
3514261993227,3cyclictest3669384-21kworker/u8:3+events_unbound22:00:220
3514270993127,3cyclictest3701189-21kworker/u8:0+flush-259:023:15:173
3514266993127,3cyclictest3362274-21kworker/u8:0+flush-259:019:20:262
3514263993126,4cyclictest3842328-21apt-get00:25:131
3514263993125,4cyclictest3769470-21gpgv23:15:011
3514263993125,4cyclictest3769470-21gpgv23:15:001
3514261993127,3cyclictest3701189-21kworker/u8:0+flush-259:023:30:210
3514261993127,3cyclictest3509121-21kworker/u8:3+events_unbound19:50:230
3514270993024,4cyclictest252-21systemd-journal21:50:003
3514263993027,2cyclictest3836528-21kworker/u8:1+flush-259:000:30:161
3514263993027,2cyclictest3737261-21kworker/u8:3+flush-259:023:05:171
3514261993026,3cyclictest3529547-21kworker/u8:1+flush-259:020:45:230
3514261993024,4cyclictest3570802-21latency_hist20:05:010
3514266992925,3cyclictest3747926-21kworker/u8:2+flush-259:023:25:262
3514266992925,3cyclictest3747926-21kworker/u8:2+flush-259:023:25:262
3514266992924,3cyclictest3701189-21kworker/u8:0+flush-259:023:50:262
3514266992923,4cyclictest3747926-21kworker/u8:2+flush-259:023:45:192
3514261992925,3cyclictest3617577-21kworker/u8:0+flush-259:021:40:130
3514261992925,3cyclictest3529547-21kworker/u8:1+flush-259:019:55:120
3514261992924,3cyclictest3530071-21diskstats19:25:130
3514261992922,5cyclictest3627418-21ntpq20:55:220
3514266992825,2cyclictest3509121-21kworker/u8:3+events_unbound19:25:232
3514266992824,3cyclictest3529547-21kworker/u8:1+flush-259:019:30:202
3514263992823,4cyclictest3602298-21cp20:35:001
3514261992824,3cyclictest3362274-21kworker/u8:0+flush-259:019:10:220
3514261992822,4cyclictest3769899-21diskstats23:15:140
3514270992723,3cyclictest3836528-21kworker/u8:1+flush-259:000:25:003
3514270992722,3cyclictest3701189-21kworker/u8:0+flush-259:022:40:163
3514270992722,3cyclictest252-21systemd-journal22:47:303
3514266992723,3cyclictest3607697-21kworker/u8:2+events_unbound20:50:212
3514266992720,5cyclictest3769154-21cp23:15:002
3514266992720,5cyclictest3769154-21cp23:15:002
3514263992723,3cyclictest3701189-21kworker/u8:0+flush-259:023:20:001
3514261992724,2cyclictest3669384-21kworker/u8:3+flush-259:022:10:140
3514261992723,3cyclictest3701189-21kworker/u8:0+events_unbound23:35:240
3514261992720,4cyclictest252-21systemd-journal21:48:440
3514266992622,3cyclictest3607697-21kworker/u8:2+flush-259:021:00:192
3514266992618,6cyclictest3715708-21ntpq22:20:202
3514261992622,3cyclictest3737261-21kworker/u8:3+events_unbound22:56:430
3514261992621,4cyclictest3607697-21kworker/u8:2+events_unbound21:20:170
3514263992521,3cyclictest3529647-21latency_hist19:25:011
3514263992520,3cyclictest3706555-21/usr/sbin/munin22:15:201
3514270992420,3cyclictest3747926-21kworker/u8:2+flush-259:000:00:173
3514270992420,3cyclictest3602115-21apt-get20:35:003
3514270992418,4cyclictest3545082-21latency_hist19:40:013
3514263992420,3cyclictest3607939-21apt-get20:40:131
3514263992418,4cyclictest3524508-21latency_hist19:20:001
3514263992418,4cyclictest3514176-21latency_hist19:10:011
3514261992421,2cyclictest3669384-21kworker/u8:3+flush-259:021:55:160
3514261992421,2cyclictest3607697-21kworker/u8:2+flush-259:020:50:210
3514261992420,3cyclictest3607697-21kworker/u8:2+flush-259:021:00:160
3514261992420,3cyclictest3607697-21kworker/u8:2+events_unbound21:40:010
3514261992420,3cyclictest3529547-21kworker/u8:1+flush-259:020:30:000
3514261992420,3cyclictest3529547-21kworker/u8:1+events_unbound19:44:430
3514261992420,3cyclictest3529547-21kworker/u8:1+events_unbound19:39:440
3514261992416,5cyclictest3742758-21cp22:50:000
3514270992319,2cyclictest3795583-21apt-get23:40:113
3514270992318,3cyclictest3847447-21/usr/sbin/munin00:30:153
351427099230,21cyclictest1-21systemd20:00:013
3514266992316,5cyclictest3653939-21latency_hist21:25:002
3514266992316,5cyclictest3628248-21latency_hist21:00:012
3514266992316,5cyclictest252-21systemd-journal21:17:422
3514263992319,3cyclictest3529911-21apt-get19:25:111
3514261992320,2cyclictest3701189-21kworker/u8:0+events_unbound00:15:290
3514261992319,3cyclictest3737261-21kworker/u8:3+events_unbound23:00:150
3514261992319,3cyclictest3509121-21kworker/u8:3+events_unbound20:07:430
3514261992318,4cyclictest3519099-21kworker/u8:2+events_unbound19:22:440
3514261992316,5cyclictest3580668-21ntpq20:10:230
3514270992217,3cyclictest3753733-21base6423:00:013
3514270992215,5cyclictest3528777-21ntpq19:20:203
3514266992218,3cyclictest3509121-21kworker/u8:3+events_unbound20:35:202
3514266992217,4cyclictest3529547-21kworker/u8:1+events_unbound20:00:212
3514266992217,4cyclictest3362274-21kworker/u8:0+events_unbound19:15:172
3514266992217,3cyclictest3509121-21kworker/u8:3+flush-259:020:45:152
3514263992219,2cyclictest3701189-21kworker/u8:0+events_unbound22:20:181
3514263992218,3cyclictest3576089-21base6420:10:011
3514263992217,3cyclictest3836741-21/usr/sbin/munin00:20:151
3514261992218,3cyclictest3836528-21kworker/u8:1+flush-259:000:35:160
3514261992218,3cyclictest3701189-21kworker/u8:0+flush-259:000:10:450
3514261992218,3cyclictest3607697-21kworker/u8:2+events_unbound21:30:230
3514261992216,4cyclictest3701189-21kworker/u8:0+flush-259:023:40:180
3514261992215,5cyclictest3602108-21latency_hist20:35:000
3514270992115,4cyclictest3732082-21latency_hist22:40:003
3514266992117,3cyclictest3529547-21kworker/u8:1+events_unbound20:20:212
3514266992115,4cyclictest3842488-21diskstats00:25:142
3514263992119,1cyclictest3679138-21kworker/u8:1+flush-259:022:05:141
3514263992117,3cyclictest3747926-21kworker/u8:2+flush-259:000:05:171
3514261992117,3cyclictest3836528-21kworker/u8:1+events_unbound00:30:220
3514261992117,3cyclictest3747926-21kworker/u8:2+events_unbound23:20:180
3514261992117,3cyclictest3679138-21kworker/u8:1+events_unbound22:08:440
3514261992117,3cyclictest3509121-21kworker/u8:3+events_unbound19:31:560
3514270992015,4cyclictest3784105-21ntpq23:25:223
3514270992015,4cyclictest3784105-21ntpq23:25:223
3514266992016,3cyclictest3509121-21kworker/u8:3+flush-259:020:15:182
3514263992016,3cyclictest3509121-21kworker/u8:3+flush-259:020:15:281
3514263992016,3cyclictest252-21systemd-journal19:57:411
3514263992015,4cyclictest509-21rs:main1
3514263992015,4cyclictest3701189-21kworker/u8:0+flush-259:000:15:141
3514263992014,4cyclictest3800457-21latency_hist23:45:001
3514261992017,2cyclictest3701189-21kworker/u8:0+events_unbound22:40:130
3514261992017,2cyclictest3529547-21kworker/u8:1+flush-259:020:17:440
3514261992016,3cyclictest3679138-21kworker/u8:1+events_unbound22:50:220
3514261992013,5cyclictest3523620-21ntpq19:15:230
3514270991914,4cyclictest3753117-21latency_hist23:00:003
3514266991916,2cyclictest3509121-21kworker/u8:3+flush-259:020:25:222
3514263991916,2cyclictest3514254-21cyclictest21:20:001
3514263991916,2cyclictest3509121-21kworker/u8:3+flush-259:019:30:161
3514263991916,2cyclictest301rcuc/100:00:001
3514263991915,3cyclictest3617577-21kworker/u8:0+flush-259:021:15:001
3514263991915,3cyclictest252-21systemd-journal20:12:231
3514261991915,3cyclictest3737261-21kworker/u8:3+flush-259:023:05:180
3514261991914,4cyclictest3607697-21kworker/u8:2+flush-259:020:40:130
3514270991814,2cyclictest3644313-21irqcore21:15:183
3514270991813,3cyclictest3514470-21apt-get19:10:123
3514270991812,4cyclictest3769053-21apt-get23:15:013
3514270991812,4cyclictest3769053-21apt-get23:15:003
3514270991812,4cyclictest3623102-21latency_hist20:55:013
3514266991815,2cyclictest3509121-21kworker/u8:3+flush-259:019:50:212
3514266991814,3cyclictest3679138-21kworker/u8:1+events_unbound22:15:242
3514266991814,3cyclictest3607697-21kworker/u8:2+flush-259:021:35:002
3514266991813,4cyclictest3540184-21/usr/sbin/munin19:35:152
3514266991811,5cyclictest3668459-21ntpq21:35:212
3514263991816,1cyclictest3685222-21cron21:55:001
3514263991814,3cyclictest3701189-21kworker/u8:0+flush-259:022:25:141
3514263991814,3cyclictest3509121-21kworker/u8:3+flush-259:020:25:131
3514261991815,2cyclictest3607697-21kworker/u8:2+events_unbound21:15:220
3514261991814,3cyclictest3701189-21kworker/u8:0+events_unbound23:29:460
3514261991814,3cyclictest3701189-21kworker/u8:0+events_unbound23:29:450
3514261991813,3cyclictest60350irq/132-enp0s29f1:rx-022:35:180
3514270991714,2cyclictest3586643-21cron20:19:593
3514270991713,3cyclictest3607697-21kworker/u8:2+flush-259:021:45:003
3514270991712,2cyclictest252-21systemd-journal23:46:443
3514270991711,4cyclictest3742904-21cat22:50:003
3514266991714,2cyclictest3691521-21irqcore22:00:172
3514266991713,3cyclictest3509121-21kworker/u8:3+flush-259:020:05:222
3514266991712,4cyclictest252-21systemd-journal22:36:432
3514263991715,1cyclictest0-21swapper/123:00:001
3514263991713,3cyclictest3701189-21kworker/u8:0+flush-259:023:30:221
3514263991713,3cyclictest3701189-21kworker/u8:0+flush-259:022:44:171
3514263991713,3cyclictest3617577-21kworker/u8:0+flush-259:020:54:591
3514263991713,3cyclictest3607697-21kworker/u8:2+flush-259:021:25:001
3514263991711,4cyclictest3613098-21apt-get20:45:131
3514261991714,2cyclictest0-21swapper/023:50:000
3514261991714,1cyclictest0-21swapper/023:55:000
3514261991713,3cyclictest60350irq/132-enp0s29f1:rx-000:00:190
3514261991713,3cyclictest3747926-21kworker/u8:2+events_unbound23:11:440
3514261991713,3cyclictest3747926-21kworker/u8:2+events_unbound23:11:440
3514261991712,4cyclictest3701189-21kworker/u8:0+flush-259:022:25:160
351426199171,15cyclictest1-21systemd00:26:440
3514270991614,1cyclictest0-21swapper/320:10:013
3514266991613,2cyclictest252-21systemd-journal20:45:002
3514266991613,2cyclictest0-21swapper/200:20:012
3514266991610,4cyclictest3654362-21diskstats21:25:132
3514263991613,2cyclictest3701835-21irqcore22:10:151
3514263991613,2cyclictest3555625-21apt-get19:50:121
3514263991613,1cyclictest0-21swapper/122:00:011
3514263991611,4cyclictest3679138-21kworker/u8:1+flush-259:022:35:141
3514263991611,3cyclictest3529547-21kworker/u8:1+flush-259:019:45:001
3514261991612,2cyclictest3701189-21kworker/u8:0+events_unbound22:32:280
3514270991512,1cyclictest0-21swapper/319:50:003
3514266991512,1cyclictest0-21swapper/223:05:002
3514266991511,3cyclictest3690415-21apt-get22:00:002
3514266991511,3cyclictest3679138-21kworker/u8:1+flush-259:022:40:212
3514263991512,2cyclictest3701189-21kworker/u8:0+events_unbound22:50:181
3514263991512,2cyclictest3570808-21grep20:05:011
3514261991513,1cyclictest60350irq/132-enp0s29f1:rx-021:25:180
3514261991511,3cyclictest3679138-21kworker/u8:1+flush-259:022:15:190
351427099149,4cyclictest3701189-21kworker/u8:0+flush-259:022:30:263
3514270991410,3cyclictest3607697-21kworker/u8:2+flush-259:021:05:173
3514270991410,3cyclictest3509121-21kworker/u8:3+flush-259:019:50:253
351426699144,9cyclictest490-21dbus-daemon00:10:002
351426699141,11cyclictest3701158-21awk22:10:002
3514266991410,3cyclictest3529547-21kworker/u8:1+flush-259:020:00:012
3514263991411,2cyclictest3638508-21sh21:09:591
3514263991410,3cyclictest3836528-21kworker/u8:1+flush-259:000:35:161
3514261991413,1cyclictest60350irq/132-enp0s29f1:rx-023:55:250
351427099139,3cyclictest3763578-21journal-offline23:07:313
351427099139,3cyclictest3617577-21kworker/u8:0+flush-259:021:04:133
351427099138,3cyclictest0-21swapper/320:40:003
3514270991311,1cyclictest0-21swapper/321:50:003
3514270991310,2cyclictest3685759-21fschecks_time21:55:153
3514270991310,1cyclictest0-21swapper/320:30:003
3514266991310,2cyclictest3820650-21unixbench_multi00:00:282
3514266991310,2cyclictest0-21swapper/221:40:222
351426399139,3cyclictest3753808-21apt-get23:00:121
351426399135,6cyclictest490-21dbus-daemon21:05:001
3514263991310,2cyclictest3804618-21needreboot23:45:211
351427099129,2cyclictest3587927-21kthreadcore20:20:163
351427099128,3cyclictest3800496-21kworker/u8:1+flush-259:023:55:233
351427099121,2cyclictest3570795-21awk20:05:003
351427099120,4cyclictest37894522switchtime23:30:213
351426699129,2cyclictest3529547-21kworker/u8:1+flush-259:020:30:202
351426699128,3cyclictest3679138-21kworker/u8:1+flush-259:022:50:242
351426699128,2cyclictest3747926-21kworker/u8:2+flush-259:023:25:002
351426699126,4cyclictest3633625-21seq21:05:112
351426699126,4cyclictest252-21systemd-journal19:15:002
351426399128,3cyclictest3679138-21kworker/u8:1+flush-259:022:45:191
351426399127,3cyclictest3816216-21apt-get00:00:131
3514263991210,1cyclictest0-21swapper/121:30:141
351427099118,2cyclictest3703720-21sort22:10:173
351427099117,2cyclictest3529547-21kworker/u8:1+flush-259:019:40:173
351426699117,3cyclictest3799992-21unixbench_multi23:40:242
351426699115,4cyclictest3769661-21base6423:15:012
351426699115,3cyclictest252-21systemd-journal19:50:002
351426399118,2cyclictest3780203-21cpuspeed_turbos23:25:141
351426399118,2cyclictest3780203-21cpuspeed_turbos23:25:141
351426699104,5cyclictest3791429-21sed23:35:182
351426399105,4cyclictest3607697-21kworker/u8:2+flush-259:021:35:161
35142709997,1cyclictest0-21swapper/321:30:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional