You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-13 - 08:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Mon Apr 13, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
259885322040,3sleep375-21kworker/3:1-events00:16:233
258556021020,7chrt0-21swapper/200:01:342
22956022700,3sleep22295600-21turbostat.cron19:15:012
24513882650,4sleep20-21swapper/221:46:342
23674912520,4sleep375-21kworker/3:1+events20:26:173
2290684994945,3cyclictest2536495-21kworker/u8:2+flush-8:023:41:342
2290678994840,5cyclictest2561270-21latency_hist23:40:010
26039212470,3sleep1281rcuc/100:21:231
2290684994237,3cyclictest2258698-21kworker/u8:1+events_unbound19:15:022
2290680994233,6cyclictest2541252-21latency_hist23:20:001
2290680994233,6cyclictest2541252-21latency_hist23:20:001
2290678994220,9cyclictest2510501-21ntpq22:46:280
24724902410,5sleep30-21swapper/322:11:193
2290678994123,3cyclictest0-21swapper/021:05:000
2290678994123,3cyclictest0-21swapper/021:05:000
2290678994035,3cyclictest2387096-21kworker/u8:3+flush-8:021:21:330
2290678994030,8cyclictest2442258-21diskstats21:41:190
2290678994029,8cyclictest2452592-21diskstats21:51:180
2290680993932,5cyclictest2362129-21latency_hist20:20:011
2290680993930,6cyclictest2411914-21latency_hist21:10:001
22903302383,7sleep10-21swapper/119:07:421
2290680993730,5cyclictest280-21systemd-journal22:43:181
2290680993631,3cyclictest2415945-21needreboot21:11:261
2290684993529,4cyclictest2258698-21kworker/u8:1+flush-8:019:36:312
2290680993530,3cyclictest2557376-21irqrtprio23:36:221
2290680993526,6cyclictest2431751-21latency_hist21:30:011
2290680993525,8cyclictest280-21systemd-journal20:55:001
2290678993530,3cyclictest2258698-21kworker/u8:1+flush-8:019:21:300
2290680993426,5cyclictest2317904-21tr19:36:151
2290680993327,4cyclictest2297874-21apt-get19:16:151
2290680993324,6cyclictest280-21systemd-journal21:31:211
22859612334,9sleep20-21swapper/219:05:542
2290684993227,3cyclictest2555989-21unixbench_singl23:31:342
2290680993126,3cyclictest2551144-21latency_hist23:30:011
2290680993126,3cyclictest2437775-21irqrtprio21:36:221
2290680993126,3cyclictest2333498-21irqrtprio19:51:231
2290680993125,4cyclictest2486653-21turbostat.cron22:25:001
2290680993125,4cyclictest2291045-21grep19:11:181
229067899318,21cyclictest2367125-21kworker/0:1+events20:46:150
2290678993126,4cyclictest885-21mta-sts-daemon23:31:340
229067899311,28cyclictest2367125-21kworker/0:1+events20:31:260
2290678993111,18cyclictest2416920-21kworker/0:2+events21:20:010
25521102300,4sleep1281rcuc/123:31:191
2290684993025,4cyclictest2467112-21kworker/u8:1+flush-8:022:06:282
2290680993025,3cyclictest2459439-21kthreadcore21:56:251
2290680993023,5cyclictest2422200-21apt-get21:21:151
2290680993022,5cyclictest280-21systemd-journal20:30:201
229067899302,27cyclictest2367125-21kworker/0:1+events20:56:490
229067899302,26cyclictest2416920-21kworker/0:2+events22:06:160
2290678993022,5cyclictest2337388-21latency_hist19:55:010
2290678993012,16cyclictest2416920-21kworker/0:2+events23:20:010
2290678993012,16cyclictest2416920-21kworker/0:2+events23:20:010
2290684992921,6cyclictest2550836-21grep23:26:352
2290680992924,3cyclictest2616988-21irqrtprio00:36:231
2290680992924,3cyclictest2536258-21idleruntime-cro23:15:001
2290680992924,3cyclictest2536258-21idleruntime-cro23:15:001
2290680992923,4cyclictest2600570-21unixbench_singl00:16:341
2290680992922,5cyclictest2387096-21kworker/u8:3+flush-8:021:46:191
2290680992922,5cyclictest2302832-21apt-get19:21:141
2290680992921,5cyclictest2295737-21kworker/u8:0+flush-8:020:26:191
2290680992917,9cyclictest280-21systemd-journal22:46:201
229067899298,20cyclictest2566236-21kworker/0:1+events00:07:590
229067899297,19cyclictest2566236-21kworker/0:1+events23:56:170
229067899292,25cyclictest2367125-21kworker/0:1+events21:06:250
2290678992910,17cyclictest2416920-21kworker/0:2+events21:46:190
22902962292,6sleep00-21swapper/019:07:170
2290684992823,3cyclictest2610608-21unixbench_multi00:26:362
2290680992823,3cyclictest2467112-21kworker/u8:1-ext4-rsv-conversion22:29:591
2290680992823,3cyclictest2462522-21cut22:01:191
2290680992823,3cyclictest2344817-21kthreadcore20:01:231
229068099282,23cyclictest2531167-21munin-run23:10:001
2290680992821,5cyclictest2258698-21kworker/u8:1+events_unbound19:25:461
2290680992821,4cyclictest2515913-21unixbench_multi22:51:401
2290680992820,6cyclictest2615107-21ntpq00:31:291
2290680992819,6cyclictest2417106-21kworker/u8:2+events_unbound21:51:301
229067899289,17cyclictest2416920-21kworker/0:2+events21:31:180
2290678992822,4cyclictest2302465-21idleruntime-cro19:20:010
2290678992821,5cyclictest280-21systemd-journal19:44:210
2290678992817,9cyclictest280-21systemd-journal19:29:590
229067899281,26cyclictest2416920-21kworker/0:2+events22:31:330
2290684992722,4cyclictest2565401-21kworker/u8:1+flush-8:000:11:322
2290684992721,4cyclictest2387096-21kworker/u8:3+events_unbound23:16:332
2290684992721,4cyclictest2387096-21kworker/u8:3+events_unbound23:16:332
2290680992722,3cyclictest401-21dbus-daemon19:49:591
2290680992722,3cyclictest2494067-21kthreadcore22:31:231
2290678992724,2cyclictest2347272-21systemd-run20:05:000
2290678992722,3cyclictest2491208-21unixbench_multi22:26:350
2290678992717,8cyclictest280-21systemd-journal23:10:000
2290678992710,16cyclictest2367125-21kworker/0:1+events21:11:330
24138162260,5sleep3451irq_work/321:11:233
2290684992623,2cyclictest2417331-21aten2_r5power_v21:16:162
2290684992623,2cyclictest2407519-21cpuspeed_turbos21:06:172
2290684992623,2cyclictest2392303-21aten2_r5power_v20:51:172
2290684992622,3cyclictest2258698-21kworker/u8:1+flush-8:019:26:282
2290684992622,2cyclictest2312733-21aten2_r5power_c19:31:152
2290684992621,3cyclictest2491556-21cron22:30:002
229068499260,8cyclictest24255121kthreadcore21:21:252
2290680992622,2cyclictest0-21swapper/122:06:251
2290680992621,3cyclictest0-21swapper/120:45:001
2290680992621,2cyclictest0-21swapper/123:01:181
2290680992621,2cyclictest0-21swapper/122:36:221
2290680992620,4cyclictest2520930-21unixbench_singl22:56:361
2290680992620,4cyclictest2366792-21unixbench_singl20:21:351
2290680992619,4cyclictest0-21swapper/123:41:141
2290680992618,6cyclictest280-21systemd-journal00:27:211
2290680992618,6cyclictest2295737-21kworker/u8:0+flush-8:020:11:191
229067899269,16cyclictest2595898-21kworker/0:0+events00:26:310
229067899269,15cyclictest2595898-21kworker/0:0+events00:36:350
229067899269,15cyclictest2416920-21kworker/0:2+events23:11:170
229067899269,15cyclictest2416920-21kworker/0:2+events23:11:170
229067899268,16cyclictest2416920-21kworker/0:2+events23:45:010
2290678992622,3cyclictest2542344-21irqrtprio23:21:250
2290678992622,2cyclictest2318590-21irqrtprio19:36:210
2290678992622,2cyclictest0-21swapper/019:35:010
2290678992621,3cyclictest2500569-21needreboot22:36:260
2290678992620,4cyclictest2386537-21unixbench_singl20:41:350
2290678992620,4cyclictest2366728-21unixbench_multi20:21:340
2290678992617,7cyclictest280-21systemd-journal00:34:300
2290678992610,14cyclictest2416920-21kworker/0:2+events22:16:270
229068099252,10cyclictest25746802kthreadcore23:51:241
2290680992520,3cyclictest0-21swapper/122:11:211
2290680992519,4cyclictest2421537-21unixbench_singl21:16:341
2290680992519,3cyclictest0-21swapper/120:56:301
2290680992519,3cyclictest0-21swapper/100:06:321
2290680992518,5cyclictest2387209-21apt-get20:46:131
2290680992518,5cyclictest2317708-21awk19:35:011
229067899259,15cyclictest2416920-21kworker/0:2+events22:56:200
229067899257,17cyclictest2416920-21kworker/0:2+events22:51:230
229067899256,18cyclictest2270817-21kworker/0:2+events19:56:310
2290678992521,2cyclictest885-21mta-sts-daemon23:51:270
2290678992521,2cyclictest0-21swapper/020:06:150
256163222414,6sleep30-21swapper/323:41:173
229068499248,2cyclictest23595142kthreadcore20:16:232
2290684992421,2cyclictest2346919-21unixbench_singl20:01:342
2290684992420,2cyclictest2511927-21cpuspeed_turbos22:51:172
2290684992419,4cyclictest2501489-21idleruntime-cro22:40:002
2290684992419,4cyclictest2417106-21kworker/u8:2+flush-8:021:31:292
2290684992418,4cyclictest2581075-21systemd00:00:012
2290684992416,6cyclictest2606021-21cron00:25:002
229068499240,22cyclictest2482324-21fschecks_count22:21:182
2290680992420,2cyclictest2446599-21idleruntime-cro21:45:001
2290680992420,2cyclictest0-21swapper/100:14:591
2290680992419,4cyclictest2387096-21kworker/u8:3+flush-8:023:23:251
2290680992418,4cyclictest2362373-21kworker/u8:2+flush-8:020:36:211
2290680992418,4cyclictest0-21swapper/120:10:001
229067899245,17cyclictest2416920-21kworker/0:2+events21:36:250
229067899242,21cyclictest0-21swapper/019:11:340
2290678992420,3cyclictest2371736-21unixbench_singl20:26:350
2290678992420,2cyclictest2521759-21cpuspeed23:01:160
2290678992420,2cyclictest0-21swapper/020:20:000
2290678992418,4cyclictest2486296-21unixbench_multi22:21:330
2290678992416,6cyclictest2551144-21latency_hist23:30:010
2290684992319,3cyclictest2302917-21aten2_r5power_p19:21:162
2290684992319,2cyclictest2531808-21aten2_r5power_v23:11:172
2290684992319,2cyclictest2531808-21aten2_r5power_v23:11:172
2290684992319,2cyclictest2322909-21aten2_r5power_e19:41:152
2290684992317,4cyclictest2442324-21fschecks_time21:41:192
2290680992318,3cyclictest2339874-21kthreadcore19:56:261
2290680992316,3cyclictest0-21swapper/122:16:351
2290680992315,6cyclictest2576433-21apt-get23:56:151
2290680992313,8cyclictest2581398-21apt-get00:01:161
229067899236,15cyclictest2416920-21kworker/0:2+events23:46:310
2290684992218,3cyclictest2406183-21kworker/u8:1+events_unbound21:01:312
2290684992218,3cyclictest2406183-21kworker/u8:1+events_unbound21:01:312
2290684992218,2cyclictest0-21swapper/223:21:292
2290684992217,4cyclictest2596125-21kworker/u8:4+flush-8:000:31:302
2290684992216,4cyclictest2565401-21kworker/u8:1+events_unbound00:06:282
2290680992217,3cyclictest2568727-21kthreadcore23:46:241
2290680992216,4cyclictest2326755-21proc_pri19:41:311
229067899226,15cyclictest2595898-21kworker/0:0+events00:25:010
2290678992218,3cyclictest2506452-21systemd-run22:45:000
2290678992218,2cyclictest0-21swapper/020:55:000
2290678992218,2cyclictest0-21swapper/020:11:260
2290678992217,4cyclictest2596879-21irqcore00:16:210
2290678992217,3cyclictest2595884-21systemd-run00:15:010
2290678992217,3cyclictest0-21swapper/022:01:240
25268952210,2sleep2161rcu_preempt23:06:202
2290684992118,2cyclictest2391526-21unixbench_singl20:46:342
2290684992117,2cyclictest0-21swapper/220:00:002
2290684992117,2cyclictest0-21swapper/219:50:012
2290684992117,2cyclictest0-21swapper/200:20:012
2290680992112,6cyclictest2406957-21latency_hist21:05:001
2290680992112,6cyclictest2406957-21latency_hist21:05:001
2290678992117,2cyclictest0-21swapper/022:11:300
2290678992116,3cyclictest0-21swapper/021:30:010
2290678992112,7cyclictest2331568-21ntpq19:46:270
2290684992017,2cyclictest2462583-21fschecks_time22:01:192
2290684992016,2cyclictest2510994-21unixbench_multi22:46:352
2290684992016,2cyclictest2353203-21irqcore20:11:212
2290684992016,2cyclictest0-21swapper/220:21:182
2290678992016,3cyclictest2585362-21mailstats00:01:320
2290678992015,3cyclictest0-21swapper/021:56:360
2290678992015,2cyclictest0-21swapper/020:40:010
229068499192,13cyclictest2367446-21apt-get20:26:152
2290684991916,2cyclictest2372731-21fschecks_time20:31:192
2290684991915,2cyclictest0-21swapper/222:56:272
2290684991915,2cyclictest0-21swapper/220:10:002
2290684991915,2cyclictest0-21swapper/200:40:002
23152212180,2sleep3481ktimers/319:31:233
2290684991813,3cyclictest0-21swapper/222:20:002
2290684991810,6cyclictest2416864-21cron21:15:012
229068499180,5cyclictest25247922cut23:01:242
229068499180,2cyclictest25722991sed23:51:212
22903542183,8sleep30-21swapper/319:08:003
229068499178,7cyclictest2474748-21tr22:11:242
2290684991713,3cyclictest401-21dbus-daemon22:00:002
229068499171,11cyclictest2495634-21ntpq22:31:272
229068499166,8cyclictest2559505-21tr23:36:242
229068499162,13cyclictest0-21swapper/223:46:462
229068499162,13cyclictest0-21swapper/222:41:072
2290684991613,2cyclictest0-21swapper/221:51:062
2290684991613,2cyclictest0-21swapper/221:36:272
2290684991613,2cyclictest0-21swapper/220:55:432
2290684991613,2cyclictest0-21swapper/219:51:562
2290684991612,2cyclictest2381550-21unixbench_multi20:36:362
2290684991612,2cyclictest0-21swapper/221:26:182
229068499161,11cyclictest2382274-21apt-get20:41:162
25516882142,8sleep30-21swapper/323:31:143
26056452132,6sleep30-21swapper/300:21:343
25461902132,7sleep30-21swapper/323:25:003
25362502132,6sleep30-21swapper/323:15:003
25362502132,6sleep30-21swapper/323:15:003
24982262132,7sleep30-21swapper/322:36:243
24668742132,6sleep30-21swapper/322:05:023
24517542132,7sleep30-21swapper/321:50:013
24416822132,6sleep30-21swapper/321:40:023
23732692132,7sleep30-21swapper/320:31:233
23422802132,5sleep30-21swapper/320:00:013
23324742132,6sleep30-21swapper/319:50:013
26103892122,6sleep30-21swapper/300:26:363
25901062123,5sleep30-21swapper/300:06:293
25859192122,6sleep30-21swapper/300:04:163
25760942122,5sleep30-21swapper/323:55:013
25662912122,6sleep30-21swapper/323:45:023
25465512122,6sleep30-21swapper/323:26:163
25219752122,6sleep30-21swapper/323:01:203
25166222122,6sleep30-21swapper/322:56:183
25103642122,6sleep30-21swapper/322:46:273
25015072122,5sleep30-21swapper/322:40:013
24869112122,6sleep30-21swapper/322:25:283
24823472121,7sleep30-21swapper/322:21:193
24810852122,6sleep30-21swapper/322:16:333
24643212123,6sleep30-21swapper/322:01:253
24577542122,6sleep30-21swapper/321:56:233
24374252122,6sleep30-21swapper/321:36:203
23978372122,6sleep30-21swapper/320:56:223
23918742122,5sleep30-21swapper/320:50:013
23872132122,6sleep30-21swapper/320:46:163
23822462122,6sleep30-21swapper/320:41:143
23781852122,6sleep30-21swapper/320:36:253
23628342122,6sleep30-21swapper/320:21:203
23581962122,6sleep30-21swapper/320:16:223
23565022123,6sleep30-21swapper/320:11:333
23518192122,6sleep30-21swapper/320:06:353
23214892122,6sleep30-21swapper/319:36:253
23074502122,5sleep30-21swapper/319:25:023
23028362122,6sleep30-21swapper/319:21:173
22926252122,6sleep30-21swapper/319:11:253
26161512112,5sleep30-21swapper/300:35:023
26133852111,6sleep30-21swapper/300:31:253
25911702112,5sleep30-21swapper/300:10:023
25714902112,6sleep30-21swapper/323:51:123
25575822112,5sleep30-21swapper/323:36:233
25366252112,5sleep30-21swapper/323:16:173
25366252112,5sleep30-21swapper/323:16:163
25299082112,6sleep30-21swapper/323:06:263
25117082112,5sleep30-21swapper/322:51:173
24917062112,5sleep30-21swapper/322:30:023
24527832112,5sleep30-21swapper/321:51:213
24319522111,6sleep30-21swapper/321:30:023
24275312112,5sleep30-21swapper/321:26:213
24265572112,6sleep30-21swapper/321:21:523
24171612112,5sleep30-21swapper/321:15:503
24075412112,5sleep30-21swapper/321:06:193
24049762112,5sleep30-21swapper/321:01:253
24049762112,5sleep30-21swapper/321:01:253
23431512112,6sleep30-21swapper/320:01:223
23276982112,5sleep30-21swapper/319:45:083
23231962112,5sleep30-21swapper/319:41:193
22958352110,6sleep30-21swapper/319:15:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional