You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-07 - 18:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Thu May 07, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2345243995144,5cyclictest252-21systemd-journal08:50:001
2345246994440,3cyclictest2412817-21kworker/u8:1+flush-259:008:45:012
2345243993732,3cyclictest252-21systemd-journal09:54:061
2345243993632,3cyclictest2345705-21apt-get07:10:111
2345243993632,2cyclictest2382124-21apt-get07:45:111
2345246993526,6cyclictest2428215-21latency_hist08:30:012
2345237993528,5cyclictest2360017-21ntpq07:20:220
2345237993421,11cyclictest2521491-21latency_hist10:00:010
2345251993228,3cyclictest2412817-21kworker/u8:1+flush-259:008:25:003
2345246993225,5cyclictest252-21systemd-journal12:35:002
2345251993127,3cyclictest2687238-21journal-offline12:36:063
2345246993125,4cyclictest2511197-21latency_hist09:50:012
2345243993124,5cyclictest2505628-21latency_hist09:45:001
2345246993022,6cyclictest2634727-21ntpq11:45:202
2345243993025,3cyclictest509-21rs:main1
2345251992925,3cyclictest2392179-21kworker/u8:0+flush-259:008:10:223
2345243992923,4cyclictest2687569-21latency_hist12:40:001
2345243992923,4cyclictest2593978-21latency_hist11:10:011
2345246992824,3cyclictest2644867-21kworker/u8:1+flush-259:012:20:232
2345246992824,3cyclictest2599150-21kworker/u8:1+flush-259:011:15:152
2345237992821,5cyclictest2620117-21latency_hist11:35:010
2345251992725,1cyclictest2500448-21latency_hist09:40:013
2345246992722,4cyclictest2620131-21kworker/u8:3+flush-259:011:50:162
2345246992720,5cyclictest252-21systemd-journal12:01:052
2345243992722,4cyclictest2392428-21apt-get07:55:131
2345246992623,2cyclictest2453942-21kworker/u8:0+flush-259:008:55:172
2345246992622,3cyclictest2505389-21kworker/u8:2+flush-259:010:10:202
2345246992622,3cyclictest2392179-21kworker/u8:0+events_unbound08:10:002
2345246992618,5cyclictest252-21systemd-journal10:35:492
2345237992620,4cyclictest252-21systemd-journal10:33:040
2345246992517,6cyclictest2499631-21ntpq09:35:232
2345243992521,3cyclictest2620131-21kworker/u8:3+flush-259:011:50:241
2345243992519,4cyclictest2635617-21latency_hist11:50:011
2345237992519,5cyclictest2530894-21ntpq10:05:210
2345237992512,12cyclictest0-21swapper/009:20:010
2345237992512,11cyclictest0-21swapper/009:39:590
2345246992420,3cyclictest2676936-21gpgv12:30:002
2345246992420,3cyclictest2644867-21kworker/u8:1+events_unbound12:05:222
2345246992420,3cyclictest2392179-21kworker/u8:0+flush-259:008:15:002
2345246992418,4cyclictest2344990-21latency_hist07:10:022
234523799249,13cyclictest2563050-21latency_hist10:40:010
2345237992421,2cyclictest2397554-21kworker/u8:2+flush-259:008:05:250
2345251992316,5cyclictest2464266-21latency_hist09:05:003
2345251992316,5cyclictest2459084-21latency_hist09:00:013
2345246992320,2cyclictest2490151-21kworker/u8:0+flush-259:009:40:152
2345246992318,4cyclictest2609530-21gpgv11:25:012
2345246992318,3cyclictest2392179-21kworker/u8:0+flush-259:008:30:152
2345243992318,3cyclictest252-21systemd-journal09:30:371
2345243992317,5cyclictest2526659-21latency_hist10:05:011
2345237992320,2cyclictest2676849-21gpgv12:30:000
2345237992318,3cyclictest2448824-21true08:50:000
2345237992318,3cyclictest2371405-21apt-get07:35:110
2345251992218,3cyclictest2470358-21kworker/u8:2+flush-259:009:30:013
2345251992218,3cyclictest2469648-21/usr/sbin/munin09:10:143
2345251992217,4cyclictest2470358-21kworker/u8:2+flush-259:009:15:153
2345246992218,3cyclictest2291698-21kworker/u8:5+flush-259:007:25:222
2345251992118,2cyclictest2651088-21munin-plugin-st12:05:003
2345251992115,5cyclictest2470358-21kworker/u8:2+flush-259:009:20:143
2345251992114,4cyclictest252-21systemd-journal11:05:003
2345246992118,2cyclictest2505389-21kworker/u8:2+flush-259:010:05:252
2345246992117,3cyclictest2563290-21kworker/u8:3+events_unbound11:10:122
2345246992116,4cyclictest2542072-21apt-get10:20:002
2345246992116,4cyclictest2291698-21kworker/u8:5+events_unbound09:05:002
2345243992116,4cyclictest2412817-21kworker/u8:1+flush-259:009:25:201
234523799218,12cyclictest500-21systemd-logind08:45:000
2345237992114,5cyclictest2583694-21latency_hist11:00:000
234523799210,19cyclictest2677486-21/usr/sbin/munin12:30:190
2345251992014,4cyclictest2291698-21kworker/u8:5+flush-259:008:00:163
2345246992016,3cyclictest2588870-21kworker/u8:2+flush-259:011:25:212
2345246992016,3cyclictest2563290-21kworker/u8:3+flush-259:010:40:162
2345246992016,3cyclictest2506283-21kworker/u8:4+events_unbound09:55:222
2345246992015,4cyclictest2644867-21kworker/u8:1+events_unbound12:18:062
2345246992015,4cyclictest2307054-21kworker/u8:3+events_unbound07:15:082
2345243992015,4cyclictest2381005-21ntpq07:40:211
2345237992013,5cyclictest2380977-21ntpq07:40:220
234523799200,2cyclictest2369012-21kthreadcore07:30:170
234523799200,1cyclictest0-21swapper/007:30:000
2345251991916,2cyclictest2622673-21kthreadcore11:35:183
2345251991914,3cyclictest2609448-21kworker/u8:0+flush-259:011:50:013
2345251991912,5cyclictest2656482-21/usr/sbin/munin12:10:143
2345246991915,3cyclictest2506283-21kworker/u8:4+events_unbound09:50:142
2345246991915,3cyclictest2291698-21kworker/u8:5+events_unbound08:15:152
2345246991914,3cyclictest2412817-21kworker/u8:1+events_unbound09:10:232
2345246991914,3cyclictest2291698-21kworker/u8:5+flush-259:007:40:162
2345243991915,3cyclictest2609411-21apt-get11:25:011
2345243991914,3cyclictest2459345-21apt-get09:00:101
2345243991913,4cyclictest2371132-21latency_hist07:35:011
234523799196,12cyclictest2645183-21processes11:55:240
234523799193,14cyclictest2382278-21df_inode07:45:110
234523799191,5cyclictest2625531-21apt-get11:40:110
234523799191,2cyclictest2525833-21ntpq10:00:200
234523799190,5cyclictest2536462-21/usr/sbin/munin10:10:250
2345251991815,2cyclictest2639955-21ntp_kernel_pll_11:50:213
2345251991814,2cyclictest0-21swapper/307:44:593
2345251991812,4cyclictest2677342-21base6412:30:013
2345251991812,4cyclictest2666761-21/usr/sbin/munin12:20:183
2345251991812,4cyclictest2588870-21kworker/u8:2+flush-259:011:20:063
2345251991812,4cyclictest2532039-21apt-get10:10:113
2345246991815,2cyclictest2620131-21kworker/u8:3+events_unbound12:36:092
2345246991815,2cyclictest2620098-21cron11:35:012
2345246991814,3cyclictest2542113-21kworker/u8:0+events_unbound10:25:232
2345246991814,3cyclictest2542113-21kworker/u8:0+events_unbound10:25:222
2345246991812,4cyclictest2578783-21/usr/sbin/munin10:55:152
2345246991811,5cyclictest2402510-21latency_hist08:05:012
2345243991814,3cyclictest252-21systemd-journal08:15:011
2345243991813,3cyclictest2480091-21apt-get09:20:111
234523799188,8cyclictest0-21swapper/011:20:010
234523799185,11cyclictest513-21gdbus08:25:010
234523799184,12cyclictest2482919-21cut09:20:170
234523799181,6cyclictest2665507-21/usr/sbin/munin12:15:180
234523799181,5cyclictest2634775-21ntpq11:45:210
234523799181,5cyclictest2577618-21ntpq10:50:190
234523799181,4cyclictest2505616-21cron09:44:590
234523799181,4cyclictest2408221-21hddtemp_smartct08:10:160
2345237991814,3cyclictest2453942-21kworker/u8:0+flush-259:009:05:190
234523799181,2cyclictest2639908-21ntpq11:50:190
234523799181,2cyclictest2551875-21ntpq10:25:210
234523799181,2cyclictest2551875-21ntpq10:25:210
234523799181,2cyclictest2489249-21ntpq09:25:200
234523799181,1cyclictest2587935-21ntpq11:00:200
234523799180,5cyclictest2398007-21tr08:00:150
234523799180,5cyclictest2355027-21sensors_temp07:15:220
234523799180,4cyclictest2510474-21/usr/sbin/munin09:45:230
234523799180,3cyclictest2686659-21ntp_kernel_err12:35:210
234523799180,3cyclictest2434621-21ps08:35:170
234523799180,2cyclictest2472623-21cut09:10:170
234523799180,1cyclictest0-21swapper/011:20:250
2345251991711,4cyclictest252-21systemd-journal10:45:013
2345251991711,4cyclictest2345645-21cp07:10:013
2345251991710,5cyclictest252-21systemd-journal11:10:013
2345246991714,2cyclictest2656282-21kworker/u8:0+flush-259:012:10:252
2345246991714,2cyclictest2366696-21irqcore07:30:152
2345246991712,3cyclictest2291698-21kworker/u8:5+flush-259:008:50:122
2345243991712,3cyclictest252-21systemd-journal08:31:001
234523799172,2cyclictest2572576-21ntpq10:45:200
234523799171,2cyclictest2593047-21ntpq11:05:210
234523799171,2cyclictest252-21systemd-journal09:35:010
234523799171,2cyclictest2461656-21ps09:00:160
234523799170,6cyclictest2458186-21ntpq08:55:220
234523799170,6cyclictest2417040-21ntpq08:15:190
234523799170,5cyclictest2620530-21df11:35:140
234523799170,5cyclictest2387587-21/usr/sbin/munin07:50:130
234523799170,4cyclictest2646271-21/usr/sbin/munin12:00:130
234523799170,4cyclictest2614984-21latency_hist11:30:010
234523799170,4cyclictest2546920-21/usr/sbin/munin10:20:220
234523799170,4cyclictest2537365-21grep10:15:130
234523799170,3cyclictest2667198-21grep12:20:150
234523799170,3cyclictest2563545-21fschecks_time10:40:130
234523799170,3cyclictest2515279-21/usr/sbin/munin09:50:200
234523799170,3cyclictest2428627-21expr08:30:120
234523799170,3cyclictest2392426-21apt07:55:130
234523799170,2cyclictest26604882sleep012:10:210
234523799170,2cyclictest2599144-21apt11:15:000
234523799170,2cyclictest2349814-21ps07:10:230
2345251991612,3cyclictest2291698-21kworker/u8:5+flush-259:008:35:263
2345251991610,4cyclictest2588870-21kworker/u8:2+flush-259:011:30:233
2345246991613,2cyclictest2291698-21kworker/u8:5+flush-259:008:35:202
2345246991612,3cyclictest2371172-21kworker/u8:1+flush-259:007:35:152
2345246991611,3cyclictest3429631-21kworker/u8:2+events_unbound07:20:152
2345243991612,3cyclictest2666543-21kworker/u8:2+flush-259:012:30:211
2345243991612,3cyclictest2376769-21sort07:40:001
2345243991612,2cyclictest0-21swapper/108:30:011
2345243991610,4cyclictest252-21systemd-journal08:37:591
234523799160,4cyclictest2652338-21/usr/sbin/munin12:05:180
234523799160,3cyclictest2427285-21netstat08:25:190
234523799160,3cyclictest2345199-21apt-key07:10:010
234523799160,2cyclictest2449356-21fw_packets08:50:150
234525199159,4cyclictest252-21systemd-journal12:09:053
2345251991510,3cyclictest2506140-21base6409:45:003
234524699158,5cyclictest2645940-21latency_hist11:59:592
2345246991512,2cyclictest2307054-21kworker/u8:3+events_unbound07:15:002
2345246991511,3cyclictest2563290-21kworker/u8:3+events_unbound10:50:232
2345246991511,3cyclictest2474667-21kworker/u8:3+events_unbound09:31:062
2345246991510,3cyclictest2291698-21kworker/u8:5+flush-259:007:50:122
2345243991512,2cyclictest2454606-21irqcore08:55:161
2345243991511,3cyclictest2578810-21apt-get10:55:121
2345243991510,4cyclictest2609411-21apt-get11:25:001
2345243991510,3cyclictest2397898-40mandb08:00:141
234525199148,4cyclictest509-21rs:main3
234525199148,4cyclictest2610078-21/usr/sbin/munin11:25:133
2345251991411,2cyclictest2552344-21unixbench_singl10:25:253
2345251991411,2cyclictest2552344-21unixbench_singl10:25:243
2345251991411,2cyclictest2525738-21ntp_kernel_err10:00:173
2345251991411,1cyclictest0-21swapper/310:40:163
2345251991410,2cyclictest0-21swapper/310:19:593
2345251991410,2cyclictest0-21swapper/307:50:003
234524699149,3cyclictest2563290-21kworker/u8:3+events_unbound10:45:212
2345246991411,2cyclictest2593953-21cron11:10:012
2345246991410,3cyclictest2505389-21kworker/u8:2+flush-259:010:00:212
2345246991410,3cyclictest2412817-21kworker/u8:1+events_unbound09:22:072
2345246991410,3cyclictest2412817-21kworker/u8:1+events_unbound08:45:232
234524399148,4cyclictest252-21systemd-journal10:15:461
234524399148,4cyclictest2474650-21latency_hist09:15:011
2345243991411,2cyclictest2468490-21ntp_kernel_err09:05:231
2345243991410,3cyclictest3429631-21kworker/u8:2+flush-259:007:25:161
234525199139,3cyclictest2474667-21kworker/u8:3+flush-259:009:30:153
234525199139,3cyclictest2443638-21sh08:45:013
234525199136,5cyclictest252-21systemd-journal10:39:593
234524699139,3cyclictest2609448-21kworker/u8:0+flush-259:011:44:092
234524699139,3cyclictest2563289-21kworker/u8:0+flush-259:011:00:152
234524699139,2cyclictest0-21swapper/209:15:192
234524699137,4cyclictest2423077-21latency_hist08:25:002
234524399139,3cyclictest2506283-21kworker/u8:4+flush-259:009:46:361
234524399137,4cyclictest2625262-21basename11:40:011
234524399130,11cyclictest1-21systemd10:33:041
234525199128,2cyclictest0-21swapper/308:25:173
234525199126,4cyclictest2620131-21kworker/u8:3+flush-259:011:40:163
2345251991210,1cyclictest2368564-21tr07:30:173
234524699129,2cyclictest2588870-21kworker/u8:2+flush-259:011:35:212
234524699129,2cyclictest2412817-21kworker/u8:1+flush-259:009:25:222
234524399129,2cyclictest2534348-21kthreadcore10:10:171
234524399129,2cyclictest2407171-21unixbench_multi08:05:261
234524399128,3cyclictest2588870-21kworker/u8:2+flush-259:011:20:011
234524399128,3cyclictest2516597-21/usr/sbin/munin09:55:131
234524399127,4cyclictest2438765-21apt-get08:40:121
2345243991210,1cyclictest0-21swapper/112:30:001
234525199118,2cyclictest2416946-21needreboot08:15:193
234525199118,2cyclictest2392511-21cpuspeed_turbos07:55:143
234525199117,3cyclictest2563289-21kworker/u8:0+flush-259:010:50:153
234525199117,3cyclictest0-21swapper/310:25:003
234524699117,3cyclictest2412817-21kworker/u8:1+flush-259:009:05:372
234524399119,1cyclictest0-21swapper/112:00:251
234524399116,3cyclictest2355977-21sshd07:20:071
234525199107,2cyclictest2443656-21turbostat08:49:563
234525199106,3cyclictest500-21systemd-logind08:55:003
234524399107,2cyclictest2660923-21unixbench_multi12:10:251
234524399106,3cyclictest2542766-21apt-get10:20:101
234524399102,2cyclictest2573435-21munin-run10:49:591
23452519991,6cyclictest2526926-21taskset10:05:133
23452439995,3cyclictest2550776-21tr10:25:181
23452439995,3cyclictest2550776-21tr10:25:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional