You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-15 - 17:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Mon Jun 15, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11013623760,2sleep375-21kworker/3:1-events08:55:013
29711921880,2sleep3471rcuc/312:30:353
3029242780,2chrt75-21kworker/3:1+events12:35:443
3844997773,3cyclictest4192615-21kworker/u8:1+flush-8:007:20:011
3843997058,9cyclictest174727-21diskstats10:30:290
3844996661,4cyclictest100167-21kworker/u8:2+flush-8:012:00:441
3844996658,6cyclictest243571-21kworker/u8:1+events_unbound12:25:431
3843996333,19cyclictest138970-21kworker/u8:0+flush-8:009:20:440
3844996254,5cyclictest119681-21kworker/u8:4+flush-8:010:20:221
3844996253,7cyclictest29599-21ntpq07:30:391
3844996155,4cyclictest119681-21kworker/u8:4+flush-8:010:30:451
3844996154,5cyclictest119681-21kworker/u8:4+events_unbound09:50:311
3844996055,4cyclictest4177720-21kworker/u8:2+events_unbound07:20:411
3844996054,4cyclictest234307-21kworker/u8:0+events_unbound11:45:291
3844996054,4cyclictest106282-21kworker/u8:3+events_unbound09:05:431
3844995955,2cyclictest234307-21kworker/u8:0+events_unbound12:05:431
3844995953,5cyclictest4145848-21kworker/u8:0+flush-8:007:35:261
3844995953,4cyclictest158907-21kworker/u8:1+events_unbound11:10:291
3844995952,5cyclictest158907-21kworker/u8:1+flush-8:011:00:361
3844995951,6cyclictest60909-21kworker/u8:1+events_unbound08:10:451
3843995953,4cyclictest199124-21kworker/u8:3+flush-8:011:25:290
3843995952,5cyclictest228656-21latency_hist11:25:000
3844995854,3cyclictest100167-21kworker/u8:2+events_unbound10:40:381
3844995751,4cyclictest119681-21kworker/u8:4+flush-8:009:35:231
3844995751,4cyclictest119681-21kworker/u8:4+events_unbound09:10:381
3844995650,4cyclictest4192615-21kworker/u8:1+events_unbound07:10:411
3844995650,4cyclictest4177720-21kworker/u8:2+flush-8:008:15:251
3844995649,5cyclictest4192615-21kworker/u8:1+events_unbound07:25:391
3843995646,8cyclictest119681-21kworker/u8:4+flush-8:009:35:360
3844995550,4cyclictest4177720-21kworker/u8:2+events_unbound07:45:371
3844995549,4cyclictest243571-21kworker/u8:1+events_unbound12:35:421
3843995545,8cyclictest84372-21ntpq08:25:380
3844995347,3cyclictest158907-21kworker/u8:1+flush-8:010:55:271
3844995248,3cyclictest4177720-21kworker/u8:2+flush-8:008:00:401
3844995247,4cyclictest199124-21kworker/u8:3+flush-8:011:35:401
3844995247,3cyclictest243571-21kworker/u8:1+events_unbound12:20:281
3844995246,4cyclictest106282-21kworker/u8:3+events_unbound09:00:361
3844995245,5cyclictest100167-21kworker/u8:2+flush-8:011:15:401
3843995240,9cyclictest59378-21ntpq08:00:390
3844995147,2cyclictest263731-21latency_hist12:00:001
3844995146,4cyclictest119681-21kworker/u8:4+events_unbound10:15:011
3844995146,3cyclictest85507-21kworker/u8:3+flush-8:008:40:331
3844995145,4cyclictest243571-21kworker/u8:1+events_unbound12:10:291
3844995145,4cyclictest199124-21kworker/u8:3+events_unbound11:25:361
3844995144,5cyclictest60909-21kworker/u8:1+flush-8:008:25:391
3843995146,4cyclictest100167-21kworker/u8:2+flush-8:011:05:430
3843995145,4cyclictest4145848-21kworker/u8:0+flush-8:007:35:260
3844995045,3cyclictest198000-21ntpq10:50:381
3844995045,3cyclictest100167-21kworker/u8:2+flush-8:011:05:411
3844995044,4cyclictest60909-21kworker/u8:1+flush-8:008:35:311
3844994943,5cyclictest4177720-21kworker/u8:2+flush-8:007:40:451
3844994943,4cyclictest100167-21kworker/u8:2+flush-8:011:20:401
3844994942,5cyclictest4177720-21kworker/u8:2+flush-8:007:50:401
3844994942,5cyclictest234307-21kworker/u8:0+events_unbound12:15:431
3844994940,7cyclictest54418-21ntpq07:55:381
3843994943,4cyclictest234307-21kworker/u8:0+flush-8:011:40:320
3843994940,7cyclictest1704890-21systemd-journal11:35:010
3843994937,9cyclictest1704890-21systemd-journal09:20:010
3844994844,3cyclictest4177720-21kworker/u8:2+flush-8:008:20:421
3844994844,3cyclictest4177720-21kworker/u8:2+flush-8:008:20:421
3844994843,3cyclictest100167-21kworker/u8:2+events_unbound11:30:451
3844994843,2cyclictest100167-21kworker/u8:2+events_unbound10:00:331
3844994841,5cyclictest293715-21/usr/sbin/munin12:30:401
3844994840,6cyclictest105370-21/usr/sbin/munin08:50:361
3844994738,7cyclictest1704890-21systemd-journal09:50:011
3843994740,5cyclictest4177720-21kworker/u8:2+flush-8:007:15:400
3844994641,4cyclictest100167-21kworker/u8:2+flush-8:008:45:441
3844994640,4cyclictest119681-21kworker/u8:4+events_unbound09:20:281
3844994639,5cyclictest119681-21kworker/u8:4+flush-8:009:15:371
3844994540,4cyclictest100167-21kworker/u8:2+flush-8:010:25:311
3843994540,4cyclictest4177720-21kworker/u8:2+flush-8:007:45:280
3843994538,5cyclictest110334-21/usr/sbin/munin08:55:360
3843994436,6cyclictest100167-21kworker/u8:2+events_unbound08:45:380
3844994337,4cyclictest106282-21kworker/u8:3+flush-8:008:55:391
3843994339,3cyclictest85507-21kworker/u8:3+events_unbound08:30:450
3843994337,4cyclictest60909-21kworker/u8:1+flush-8:008:15:400
3843994337,4cyclictest158907-21kworker/u8:1+events_unbound11:00:420
3843994333,7cyclictest1704890-21systemd-journal07:15:010
3843994332,9cyclictest140545-21cp09:30:010
3844994235,5cyclictest4177720-21kworker/u8:2+events_unbound08:05:311
3843994236,4cyclictest243571-21kworker/u8:1+events_unbound11:40:000
3843994236,4cyclictest119681-21kworker/u8:4+flush-8:010:20:240
3848994135,4cyclictest234307-21kworker/u8:0+flush-8:012:10:402
3848994133,6cyclictest234217-21cat11:30:002
3844994134,6cyclictest100167-21kworker/u8:2+events_unbound11:50:401
3843994135,4cyclictest106282-21kworker/u8:3+events_unbound09:05:450
3843994129,8cyclictest4177720-21kworker/u8:2+flush-8:008:20:260
3843994129,8cyclictest4177720-21kworker/u8:2+flush-8:008:20:250
3844993934,3cyclictest234307-21kworker/u8:0+flush-8:011:40:361
3843993934,4cyclictest4177720-21kworker/u8:2+flush-8:007:30:300
3843993932,5cyclictest55334-21latency_hist08:00:000
3843993932,5cyclictest243571-21kworker/u8:1+flush-8:012:30:380
3843993932,5cyclictest100167-21kworker/u8:2+flush-8:010:55:370
3844993834,3cyclictest60909-21kworker/u8:1+flush-8:008:30:301
3843993833,4cyclictest60909-21kworker/u8:1+flush-8:008:40:360
3843993831,5cyclictest278167-21kworker/u8:3+events_unbound12:15:370
3843993733,3cyclictest60909-21kworker/u8:1+events_unbound08:50:430
3843993733,3cyclictest287685-21kworker/u8:2+flush-8:012:24:050
3843993731,5cyclictest100167-21kworker/u8:2+events_unbound10:10:380
3843993731,4cyclictest60909-21kworker/u8:1+events_unbound08:35:430
3843993728,6cyclictest1704890-21systemd-journal11:55:350
3843993632,3cyclictest234307-21kworker/u8:0+flush-8:012:05:440
3843993632,3cyclictest189255-21kworker/u8:0+flush-8:010:45:300
3843993632,3cyclictest119681-21kworker/u8:4+events_unbound09:50:380
3843993631,4cyclictest100167-21kworker/u8:2+flush-8:011:45:440
3843993631,3cyclictest119681-21kworker/u8:4+flush-8:009:10:430
3843993630,5cyclictest158907-21kworker/u8:1+events_unbound10:35:330
3843993630,5cyclictest158907-21kworker/u8:1+events_unbound10:35:320
3843993628,5cyclictest1704890-21systemd-journal10:15:430
3844993531,3cyclictest158907-21kworker/u8:1+events_unbound10:35:491
3844993531,3cyclictest158907-21kworker/u8:1+events_unbound10:35:481
3844993529,4cyclictest189255-21kworker/u8:0+events_unbound10:45:451
3843993530,3cyclictest119681-21kworker/u8:4+events_unbound10:10:010
3848993428,5cyclictest70448-21kworker/u8:0+flush-8:008:45:482
3848993428,5cyclictest164962-21kworker/u8:0+flush-8:010:20:332
3843993430,3cyclictest278167-21kworker/u8:3+events_unbound12:35:270
3843993428,4cyclictest243571-21kworker/u8:1+events_unbound12:25:290
3848993326,5cyclictest1704890-21systemd-journal07:10:562
3848993323,7cyclictest65609-21cat08:10:012
3848993322,9cyclictest1704890-21systemd-journal12:19:592
3843993328,3cyclictest106282-21kworker/u8:3+flush-8:009:00:060
3848993226,4cyclictest36107-21fschecks_count07:40:322
3848993226,4cyclictest188637-21unixbench_singl10:40:452
3844993227,4cyclictest119681-21kworker/u8:4+flush-8:010:06:281
3843993227,3cyclictest100167-21kworker/u8:2+flush-8:010:25:430
3843993127,3cyclictest243571-21kworker/u8:1+events_unbound11:50:250
3848993026,3cyclictest234307-21kworker/u8:0+flush-8:011:30:402
3843993027,2cyclictest4177720-21kworker/u8:2+events_unbound07:50:420
3843993025,4cyclictest4177720-21kworker/u8:2+flush-8:007:25:440
3843993025,4cyclictest4177720-21kworker/u8:2+flush-8:007:20:350
3843993025,3cyclictest65233-21cron08:10:000
3843993024,4cyclictest4177720-21kworker/u8:2+events_unbound07:40:420
3843993024,4cyclictest100167-21kworker/u8:2+flush-8:010:40:390
3848992924,4cyclictest278167-21kworker/u8:3+flush-8:012:35:452
3843992922,5cyclictest268706-21latency_hist12:05:010
3848992820,6cyclictest4027-21cp07:10:012
3843992821,5cyclictest100167-21kworker/u8:2+flush-8:010:50:490
3848992722,3cyclictest50774-21aten2_r5power_v07:55:282
3844992715,8cyclictest140445-21apt-get09:30:001
3843992721,4cyclictest100167-21kworker/u8:2+events_unbound09:30:000
2530632270,6sleep3451irq_work/311:45:403
3848992623,2cyclictest189597-21fschecks_count10:45:302
3848992622,2cyclictest35079-21grep07:35:422
3848992622,2cyclictest214297-21tr11:10:272
3843992622,3cyclictest218934-21kworker/u8:0+flush-8:011:15:340
3843992622,3cyclictest158907-21kworker/u8:1+flush-8:011:11:290
3843992621,3cyclictest70418-21cron08:14:590
3848992522,2cyclictest169741-21cpuspeed_turbos10:25:282
3848992521,2cyclictest159192-21cpuspeed_turbos10:10:272
3848992512,9cyclictest40769-21apt-get07:45:242
384399250,23cyclictest583-21snmpd07:10:000
3848992420,2cyclictest81553-21kthreadcore08:25:322
3848992420,2cyclictest178747-21unixbench_singl10:30:452
3848992419,4cyclictest138970-21kworker/u8:0+flush-8:009:20:402
3848992410,2cyclictest2518892cut11:45:352
3843992419,3cyclictest100167-21kworker/u8:2+flush-8:010:00:330
3843992415,7cyclictest0-21swapper/010:00:000
3848992318,4cyclictest258420-21unixbench_singl11:50:452
3848992317,4cyclictest134476-21unixbench_singl09:15:432
3844992319,2cyclictest3861-21latency_hist07:10:001
3844992318,4cyclictest138970-21kworker/u8:0+events_unbound09:30:571
384899223,3cyclictest169742tr07:20:332
3848992219,2cyclictest248517-21unixbench_multi11:40:452
3848992219,2cyclictest204887-21irqrtprio11:00:312
3848992218,2cyclictest0-21swapper/207:35:002
3848992214,6cyclictest1704890-21systemd-journal09:54:592
3844992218,3cyclictest158907-21kworker/u8:1+events_unbound10:18:261
384899212,14cyclictest45725-21apt-get07:50:272
3848992118,2cyclictest284243-21fschecks_time12:20:292
3848992117,3cyclictest223669-21cron11:20:012
3848992115,5cyclictest60909-21kworker/u8:1+flush-8:008:15:352
3848992114,5cyclictest1704890-21systemd-journal10:40:002
3848992114,5cyclictest1704890-21systemd-journal10:39:592
3848992112,7cyclictest95150-21cron08:40:012
3848992112,7cyclictest112016-21tr08:55:342
3844992117,3cyclictest100167-21kworker/u8:2+events_unbound09:43:451
3843992113,5cyclictest147566-21true09:50:000
3848992016,2cyclictest153621-21cpuspeed_turbos10:00:272
3848992016,2cyclictest0-21swapper/211:25:012
3848992015,4cyclictest66096-21cut08:10:312
3843992016,2cyclictest0-21swapper/012:10:430
41927662192,8sleep30-21swapper/307:05:023
384899199,8cyclictest1704890-21systemd-journal09:05:002
3848991916,2cyclictest194326-21aten2_r5power_p10:50:272
3848991916,2cyclictest0-21swapper/212:30:312
3848991915,3cyclictest153105-21sh10:00:002
3848991915,2cyclictest259355-21fschecks_count11:55:282
3848991915,2cyclictest0-21swapper/208:00:312
3848991913,4cyclictest265976-21kthreadcore12:00:342
384899182,11cyclictest124065-21ntpq09:05:392
3848991814,3cyclictest0-21swapper/208:55:012
3848991814,2cyclictest0-21swapper/209:30:012
3848991813,3cyclictest209666-21irqcore11:05:332
3844991813,4cyclictest119681-21kworker/u8:4+flush-8:009:55:061
3843991815,2cyclictest0-21swapper/009:45:010
3848991713,2cyclictest0-21swapper/212:30:002
3848991713,2cyclictest0-21swapper/209:10:352
3848991712,4cyclictest60909-21kworker/u8:1+flush-8:008:30:272
3848991712,3cyclictest0-21swapper/208:40:352
384899167,7cyclictest201061-21tr10:55:342
384899167,7cyclictest12735-21tr07:15:332
384899166,8cyclictest158727-21sed10:10:002
384899162,10cyclictest272741-21ntpq12:05:392
3848991613,2cyclictest0-21swapper/210:16:072
3848991613,2cyclictest0-21swapper/208:21:522
3848991613,2cyclictest0-21swapper/208:21:522
3848991612,3cyclictest0-21swapper/211:35:332
3848991612,2cyclictest0-21swapper/209:35:402
3848991612,2cyclictest0-21swapper/207:25:352
79482156,5sleep30-21swapper/307:10:393
384899152,12cyclictest0-21swapper/209:31:372
3848991510,4cyclictest146930-21turbostat.cron09:45:002
1589632158,4sleep30-21swapper/310:10:263
2236682142,7sleep30-21swapper/311:20:013
916962132,7sleep30-21swapper/308:35:363
2897702134,5sleep30-21swapper/312:25:353
1644742132,6sleep30-21swapper/310:20:023
896342122,6sleep30-21swapper/308:30:453
661262122,6sleep30-21swapper/308:10:323
641772122,6sleep30-21swapper/308:05:383
561052122,6sleep30-21swapper/308:00:323
454582122,5sleep30-21swapper/307:50:013
410112122,6sleep30-21swapper/307:45:273
384899128,2cyclictest0-21swapper/209:49:342
358202122,6sleep30-21swapper/307:40:303
327102122,6sleep30-21swapper/307:35:323
2879552122,6sleep30-21swapper/312:20:453
2835822120,7sleep30-21swapper/312:20:003
2736832122,5sleep30-21swapper/312:10:023
2689862122,6sleep30-21swapper/312:05:283
2632732122,6sleep30-21swapper/311:55:453
2586612123,5sleep30-21swapper/311:53:123
253922122,6sleep30-21swapper/307:27:583
2391652122,5sleep30-21swapper/311:35:023
2337912123,5sleep30-21swapper/311:29:323
2138112122,5sleep30-21swapper/311:10:013
1942442123,5sleep30-21swapper/310:50:283
1843152122,6sleep30-21swapper/310:40:243
1733982122,6sleep30-21swapper/310:25:433
1519282122,6sleep30-21swapper/309:50:403
1389262122,6sleep30-21swapper/309:20:383
1344252122,6sleep30-21swapper/309:15:453
1252832122,6sleep30-21swapper/309:10:273
1200012122,5sleep30-21swapper/309:05:013
1193612122,6sleep30-21swapper/309:00:443
1101362122,6sleep30-21swapper/308:55:023
102822122,6sleep30-21swapper/307:15:063
957282112,5sleep30-21swapper/308:40:303
846342112,6sleep30-21swapper/308:25:453
756962112,5sleep30-21swapper/308:20:273
756962112,5sleep30-21swapper/308:20:263
704552112,5sleep30-21swapper/308:15:013
506032112,5sleep30-21swapper/307:55:033
2639682112,5sleep30-21swapper/312:00:013
257902112,5sleep30-21swapper/307:30:023
2446402112,6sleep30-21swapper/311:40:323
2343032112,5sleep30-21swapper/311:30:053
2242302112,5sleep30-21swapper/311:20:303
2091892112,6sleep30-21swapper/311:05:293
2046452110,6sleep30-21swapper/311:00:313
199712112,5sleep30-21swapper/307:20:443
1994242112,5sleep30-21swapper/310:55:283
1892542112,6sleep30-21swapper/310:45:063
1803132112,5sleep30-21swapper/310:35:353
1803132112,5sleep30-21swapper/310:35:353
1742132112,5sleep30-21swapper/310:30:013
1585722113,5sleep30-21swapper/310:08:463
1538442112,5sleep30-21swapper/310:00:323
1525082112,4sleep30-21swapper/309:55:013
1471512112,5sleep30-21swapper/309:45:033
1468582112,6sleep30-21swapper/309:44:183
1415952112,5sleep30-21swapper/309:35:223
1409292112,5sleep30-21swapper/309:30:223
1400932112,6sleep30-21swapper/309:25:363
1007922112,5sleep30-21swapper/308:45:303
1638882102,5sleep30-21swapper/310:15:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional