You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-30 - 12:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Thu Apr 30, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
331296522000,2sleep375-21kworker/3:1-events21:01:223
32598752790,6sleep375-21kworker/3:1+mm_percpu_wq20:11:103
3196896995854,3cyclictest3209147-21kworker/u8:4+events_unbound21:46:071
3196894995649,5cyclictest3209147-21kworker/u8:4+flush-8:019:46:190
3196896995450,3cyclictest3201893-21kworker/u8:3+events_unbound19:21:051
3196894995447,4cyclictest3182041-21kworker/u8:1+flush-8:019:11:070
3196896995349,3cyclictest3293523-21kworker/u8:0+events_unbound00:16:071
3196896995248,3cyclictest3402835-21kworker/u8:1+events_unbound23:16:051
3196896995248,3cyclictest3209147-21kworker/u8:4+events_unbound19:41:191
3196900995146,4cyclictest3209147-21kworker/u8:4+flush-8:021:41:202
3196896994945,3cyclictest3396996-21kworker/u8:3+events_unbound22:56:041
3196896994935,10cyclictest280-21systemd-journal21:05:551
3196894994941,6cyclictest3293523-21kworker/u8:0+flush-8:021:10:000
3196900994842,4cyclictest3342177-21kworker/u8:1+flush-8:022:46:162
3196896994844,3cyclictest3418901-21kworker/u8:3+events_unbound00:36:171
3196896994844,3cyclictest3342177-21kworker/u8:1+events_unbound21:56:201
3196896994844,3cyclictest3182041-21kworker/u8:1+events_unbound19:56:151
3196896994843,4cyclictest3209147-21kworker/u8:4+events_unbound20:01:181
3196896994841,5cyclictest3402577-21latency_hist23:05:011
3196896994642,3cyclictest2187314-21kworker/u8:0+events_unbound19:11:241
3196896994541,3cyclictest3418901-21kworker/u8:3+events_unbound23:46:041
3196900994440,3cyclictest3293523-21kworker/u8:0+events_unbound00:35:012
3196896994440,3cyclictest3293523-21kworker/u8:0+events_unbound22:21:231
3196900994338,4cyclictest3396137-21kworker/u8:2+flush-8:023:16:212
3196896994339,3cyclictest3293523-21kworker/u8:0+events_unbound00:29:391
3196896994339,3cyclictest3267768-21kworker/u8:2+events_unbound20:36:121
3196896994339,3cyclictest3238859-21kworker/u8:0+events_unbound20:16:101
3196896994339,3cyclictest3201893-21kworker/u8:3+events_unbound19:25:571
3196896994339,3cyclictest3182041-21kworker/u8:1+events_unbound20:41:101
3196894994337,4cyclictest3338356-21apt-get21:31:020
3196894994336,5cyclictest3434526-21ntpq23:56:150
3196894994336,5cyclictest3434526-21ntpq23:56:150
3196894994332,8cyclictest280-21systemd-journal22:20:010
3196900994238,3cyclictest2187314-21kworker/u8:0+flush-8:019:16:162
3196896994238,3cyclictest3396137-21kworker/u8:2+events_unbound23:24:561
3196896994238,3cyclictest3293523-21kworker/u8:0+events_unbound21:51:151
3196896994238,3cyclictest3209147-21kworker/u8:4+events_unbound21:36:071
3196896994238,3cyclictest3209147-21kworker/u8:4+events_unbound21:25:031
3196896994238,3cyclictest3182041-21kworker/u8:1+events_unbound19:45:571
3196896994232,8cyclictest3372339-21ntpq22:06:171
3196894994238,3cyclictest2187314-21kworker/u8:0+flush-8:019:16:060
3196894994236,4cyclictest3201893-21kworker/u8:3+flush-8:019:31:100
3196900994132,6cyclictest280-21systemd-journal19:15:012
3196896994137,3cyclictest3402835-21kworker/u8:1+events_unbound23:12:571
3196896994137,3cyclictest3209147-21kworker/u8:4+events_unbound19:31:051
3196900994035,4cyclictest3293523-21kworker/u8:0+flush-8:023:26:212
3196900994033,5cyclictest3182041-21kworker/u8:1+flush-8:019:51:102
3196900994033,5cyclictest3182041-21kworker/u8:1+flush-8:019:51:102
3196896994036,3cyclictest3342177-21kworker/u8:1+events_unbound21:33:561
3196896994036,3cyclictest3293523-21kworker/u8:0+events_unbound00:05:061
3196896994036,3cyclictest3267768-21kworker/u8:2+events_unbound21:11:551
3196896994036,3cyclictest3267768-21kworker/u8:2+events_unbound21:03:561
3196896994036,3cyclictest3182041-21kworker/u8:1+events_unbound20:32:581
3196900993934,4cyclictest3182041-21kworker/u8:1+flush-8:020:41:202
3196896993936,2cyclictest3293523-21kworker/u8:0+events_unbound22:46:571
3196896993935,3cyclictest3418901-21kworker/u8:3+events_unbound23:30:401
3196896993935,3cyclictest3293523-21kworker/u8:0+events_unbound23:53:201
3196896993935,3cyclictest3293523-21kworker/u8:0+events_unbound23:53:191
3196896993935,3cyclictest3293523-21kworker/u8:0+events_unbound23:40:021
3196896993924,5cyclictest3258949-21apt-get20:11:021
3196900993834,3cyclictest3209147-21kworker/u8:4+flush-8:022:36:202
3196900993833,4cyclictest3182041-21kworker/u8:1+flush-8:020:36:052
3196896993835,2cyclictest3293523-21kworker/u8:0+events_unbound20:49:561
3196896993835,2cyclictest3209147-21kworker/u8:4+events_unbound20:06:221
3196896993834,3cyclictest3293523-21kworker/u8:0+events_unbound23:37:571
3196896993834,3cyclictest3209147-21kworker/u8:4+events_unbound22:12:551
3196900993732,4cyclictest3238859-21kworker/u8:0+events_unbound20:11:192
3196900993731,4cyclictest280-21systemd-journal23:50:002
3196896993734,2cyclictest3209147-21kworker/u8:4+events_unbound20:27:561
3196896993733,3cyclictest3267768-21kworker/u8:2+events_unbound21:16:231
3196896993733,3cyclictest3209147-21kworker/u8:4+events_unbound22:36:451
3196896993733,3cyclictest3209147-21kworker/u8:4+events_unbound19:50:011
3196896993733,3cyclictest3209147-21kworker/u8:4+events_unbound19:50:011
319689499370,35cyclictest1-21systemd20:45:000
3196896993632,3cyclictest3293523-21kworker/u8:0+events_unbound00:34:431
3196896993624,4cyclictest280-21systemd-journal22:33:551
3196896993622,6cyclictest3268835-21apt-get20:21:001
3196900993531,3cyclictest3209147-21kworker/u8:4+flush-8:019:36:102
3196900993528,5cyclictest3293523-21kworker/u8:0+events_unbound22:16:162
3196896993531,3cyclictest3402835-21kworker/u8:1+events_unbound23:55:581
3196896993531,3cyclictest3402835-21kworker/u8:1+events_unbound23:55:581
3196896993531,3cyclictest3342177-21kworker/u8:1+events_unbound22:50:031
3196896993531,3cyclictest3293523-21kworker/u8:0+events_unbound23:05:571
3196896993531,3cyclictest3293523-21kworker/u8:0+events_unbound22:15:321
3196896993530,4cyclictest3293523-21kworker/u8:0+events_unbound20:57:541
3196896993530,4cyclictest3293523-21kworker/u8:0+events_unbound20:54:101
3196896993530,4cyclictest3209147-21kworker/u8:4+events_unbound19:35:551
3196894993531,3cyclictest3201893-21kworker/u8:3+flush-8:019:26:080
3196896993430,3cyclictest3418901-21kworker/u8:3+events_unbound00:20:031
3196896993430,3cyclictest3418901-21kworker/u8:3+events_unbound00:10:031
3196896993430,3cyclictest3402835-21kworker/u8:1+events_unbound23:27:261
3196896993430,3cyclictest3293523-21kworker/u8:0+events_unbound22:25:531
3196896993429,4cyclictest3293523-21kworker/u8:0+events_unbound00:04:501
3196896993429,3cyclictest3293523-21kworker/u8:0+events_unbound22:40:211
3196894993426,6cyclictest3258924-21/usr/sbin/munin20:11:150
3196894993423,9cyclictest280-21systemd-journal21:20:000
3196894993420,5cyclictest3267768-21kworker/u8:2+flush-8:020:21:140
3196900993328,4cyclictest3342177-21kworker/u8:1+events_unbound21:31:192
3196900993328,4cyclictest3293523-21kworker/u8:0+flush-8:021:01:152
3196900993328,4cyclictest3293523-21kworker/u8:0+events_unbound00:36:242
3196896993329,3cyclictest3293523-21kworker/u8:0+events_unbound22:00:531
3196896993329,3cyclictest3293523-21kworker/u8:0+events_unbound21:43:361
3196896993329,3cyclictest3267768-21kworker/u8:2+events_unbound21:22:371
3196896993329,3cyclictest2187314-21kworker/u8:0+events_unbound19:15:371
3196894993329,3cyclictest3401763-21systemd-run23:00:010
3196894993326,5cyclictest280-21systemd-journal22:26:240
3196900993227,4cyclictest3293523-21kworker/u8:0+events_unbound23:52:422
3196900993227,4cyclictest3293523-21kworker/u8:0+events_unbound23:52:422
3196894993226,4cyclictest1-21systemd00:20:000
3196894993225,5cyclictest280-21systemd-journal19:40:430
3196894993224,6cyclictest280-21systemd-journal22:00:010
3196894993223,7cyclictest3293574-21/usr/sbin/munin20:46:200
3196894993222,8cyclictest3244376-21diskstats19:56:040
319689499321,29cyclictest3385403-21munin-run22:35:000
31920612324,9sleep20-21swapper/219:05:212
3196900993126,4cyclictest3182041-21kworker/u8:1+events_unbound20:16:222
3196900993125,4cyclictest3373196-21gpgv22:10:012
3196894993126,4cyclictest3201893-21kworker/u8:3+flush-8:019:21:070
3196900993025,4cyclictest3308323-21idleruntime-cro21:00:002
3196900993024,4cyclictest3435371-40logrotate00:00:002
3196900993024,4cyclictest3435371-40logrotate00:00:002
3196894993020,8cyclictest280-21systemd-journal21:00:000
31966552302,6sleep00-21swapper/019:09:290
3196900992925,2cyclictest3248720-21cron20:00:002
3196894992924,3cyclictest3313256-21cron21:05:000
3196894992923,4cyclictest3228714-21cron19:39:590
3196900992822,4cyclictest3299082-21fschecks_time20:51:072
3196900992822,4cyclictest3233817-21latency_hist19:44:592
3196900992819,7cyclictest280-21systemd-journal00:05:002
3196894992824,3cyclictest3396137-21kworker/u8:2+flush-8:023:01:260
3196894992824,2cyclictest3396117-21apt22:50:000
3196894992823,3cyclictest3209147-21kworker/u8:4+flush-8:021:26:050
3196894992823,3cyclictest3209147-21kworker/u8:4+events_unbound21:25:010
3196894992811,4cyclictest0-21swapper/021:11:080
3196900992723,2cyclictest3436392-21aten2_r5power_e00:06:022
319689499279,16cyclictest3191848-21kworker/0:1+events20:06:150
3196894992723,2cyclictest3354099-21kthreadcore21:46:090
3196894992720,4cyclictest3293523-21kworker/u8:0+events_unbound00:06:180
3196894992717,7cyclictest3298204-21apt-get20:50:000
3196894992622,3cyclictest3402835-21kworker/u8:1+events_unbound23:26:060
3196894992621,3cyclictest3447184-21true00:25:010
3196894992620,4cyclictest3268160-21unixbench_singl20:16:240
3196900992522,2cyclictest3423856-21unixbench_multi23:36:222
3196900992522,2cyclictest3254100-21aten2_r5power_p20:06:042
3196894992521,3cyclictest3453556-21sort00:36:070
3196894992521,3cyclictest3209147-21kworker/u8:4+flush-8:020:01:170
3196894992520,4cyclictest3374174-21apt-config22:15:010
3196894992519,4cyclictest3418901-21kworker/u8:3+flush-8:000:26:240
3196894992518,5cyclictest3209147-21kworker/u8:4+flush-8:021:36:050
3196900992421,2cyclictest3332760-21unixbench_singl21:21:212
3196900992420,3cyclictest401-21dbus-daemon23:35:002
3196900992419,3cyclictest3223777-21cron19:35:002
3196900992418,4cyclictest3451729-21unixbench_singl00:26:212
3196894992422,1cyclictest8550irq/124-ahci[0000:00:12.0]23:10:010
3196894992420,2cyclictest0-21swapper/023:35:000
3196894992419,3cyclictest280-21systemd-journal22:25:010
3196894992418,4cyclictest3418901-21kworker/u8:3+events_unbound23:36:140
3196894992418,4cyclictest3412764-21unixbench_singl23:16:210
3196894992417,5cyclictest280-21systemd-journal22:39:550
3196894992416,6cyclictest3267768-21kworker/u8:2+flush-8:020:31:120
3196900992319,3cyclictest3298412-21latency_hist20:50:012
3196900992319,2cyclictest3363309-21fschecks_count21:56:072
3196900992315,6cyclictest280-21systemd-journal20:35:002
3196900992314,2cyclictest33817391kthreadcore22:26:112
3196894992319,2cyclictest1-21systemd23:15:010
3196894992319,2cyclictest0-21swapper/020:26:220
3196894992318,4cyclictest3352495-21unixbench_multi21:41:220
3196894992318,3cyclictest3391185-21cron22:45:000
3196900992218,3cyclictest3396137-21kworker/u8:2+flush-8:023:00:162
3196900992218,3cyclictest3396137-21kworker/u8:2+events_unbound23:10:342
3196894992218,3cyclictest3373283-21apt-key22:10:010
3196894992218,3cyclictest3293523-21kworker/u8:0+flush-8:023:41:030
3196894992218,3cyclictest3182041-21kworker/u8:1+flush-8:019:51:060
3196894992218,3cyclictest3182041-21kworker/u8:1+flush-8:019:51:050
3196894992218,2cyclictest0-21swapper/023:50:000
3196894992217,4cyclictest3267768-21kworker/u8:2+events_unbound20:36:070
319690099215,2cyclictest161rcu_preempt23:06:212
3196900992112,7cyclictest3374472-21sed22:15:022
3196894992116,4cyclictest3293523-21kworker/u8:0+events_unbound21:51:190
31920602214,10sleep10-21swapper/119:05:201
3196900992017,2cyclictest3313900-21fschecks_time21:06:062
3196900992016,3cyclictest3293523-21kworker/u8:0+events_unbound22:55:182
3196900992016,2cyclictest3318793-21fschecks_count21:11:082
3196900992016,2cyclictest0-21swapper/221:46:082
3196900992016,2cyclictest0-21swapper/219:46:162
319690099200,7cyclictest3358278-21cpuspeed21:51:052
31920272203,8sleep30-21swapper/319:05:023
319690099192,5cyclictest3272567-21netstat20:21:122
3196900991916,2cyclictest0-21swapper/221:26:142
3196900991914,3cyclictest0-21swapper/220:29:592
3196900991910,7cyclictest3345657-21tr21:36:112
319690099190,6cyclictest3215623-21kthreadcore19:26:092
3196894991913,4cyclictest3396738-21sh22:55:000
3196894991913,3cyclictest3452851-21latency_hist00:35:000
319690099182,5cyclictest0-21swapper/222:04:562
319690099182,4cyclictest0-21swapper/223:24:302
319690099182,4cyclictest0-21swapper/200:21:472
319690099181,3cyclictest161rcu_preempt20:01:092
319690099180,6cyclictest161rcu_preempt23:45:012
3196894991814,3cyclictest3402835-21kworker/u8:1+flush-8:023:20:140
32260212170,2sleep375-21kworker/3:1-mm_percpu_wq19:36:113
319690099173,7cyclictest0-21swapper/219:20:472
319690099172,5cyclictest0-21swapper/222:50:352
319690099172,5cyclictest0-21swapper/222:33:532
3196900991711,4cyclictest0-21swapper/221:16:112
319690099162,4cyclictest0-21swapper/200:12:522
319690099162,2cyclictest0-21swapper/200:16:062
319690099162,13cyclictest0-21swapper/222:42:422
3196900991613,2cyclictest0-21swapper/222:21:472
3196894991611,3cyclictest0-21swapper/000:12:060
3196894991513,1cyclictest0-21swapper/023:50:450
3196894991513,1cyclictest0-21swapper/023:50:450
3196894991513,1cyclictest0-21swapper/000:03:480
3196894991511,3cyclictest0-21swapper/022:05:010
34289792143,8sleep30-21swapper/323:46:163
33283232140,4chrt0-21swapper/321:20:003
34363372132,7sleep30-21swapper/300:06:033
34201242132,7sleep30-21swapper/323:36:093
33769232133,6sleep30-21swapper/322:16:123
32784472132,6sleep30-21swapper/320:30:023
32536982132,6sleep30-21swapper/320:05:023
34510602122,6sleep30-21swapper/300:26:133
34415882122,6sleep30-21swapper/300:15:023
34346722122,6sleep30-21swapper/323:56:203
34346722122,6sleep30-21swapper/323:56:193
34138842122,5sleep30-21swapper/323:25:023
34029052122,6sleep30-21swapper/323:06:043
34006752122,6sleep30-21swapper/322:56:123
33845782122,6sleep30-21swapper/322:27:563
33732432122,5sleep30-21swapper/322:10:023
33580742122,6sleep30-21swapper/321:50:563
33034212121,6sleep30-21swapper/320:55:023
32987702122,6sleep30-21swapper/320:51:043
32981042122,6sleep30-21swapper/320:48:563
32837022122,6sleep30-21swapper/320:36:043
32642542123,6sleep30-21swapper/320:16:093
32495632122,6sleep30-21swapper/320:01:083
32385412122,6sleep30-21swapper/319:46:243
32288812122,6sleep30-21swapper/319:40:023
32135902122,6sleep30-21swapper/319:21:243
32037312122,6sleep30-21swapper/319:15:063
31994752122,6sleep30-21swapper/319:11:113
34529982112,5sleep30-21swapper/300:36:013
34354132112,5sleep30-21swapper/300:00:013
34300462112,5sleep30-21swapper/323:50:023
34300462112,5sleep30-21swapper/323:50:023
34248192112,5sleep30-21swapper/323:44:163
34189582111,6sleep30-21swapper/323:30:563
34088522112,5sleep30-21swapper/323:16:073
34078652112,5sleep30-21swapper/323:11:293
34018422111,5sleep30-21swapper/323:00:023
33917562111,6sleep30-21swapper/322:46:053
33854042111,5sleep30-21swapper/322:35:023
33685962112,5sleep30-21swapper/322:06:043
33681672113,5sleep30-21swapper/322:03:563
33531242112,5sleep30-21swapper/321:45:423
33482332112,5sleep30-21swapper/321:40:563
33450562112,5sleep30-21swapper/321:36:113
33380422112,5sleep30-21swapper/321:30:013
33334232112,6sleep30-21swapper/321:26:043
33283232112,5sleep30-21swapper/321:20:023
33184202112,5sleep30-21swapper/321:10:033
33140752110,6sleep30-21swapper/321:06:093
32924172112,5sleep30-21swapper/320:41:173
32742142112,6sleep30-21swapper/320:26:083
32687302112,5sleep30-21swapper/320:20:023
32441312112,5sleep30-21swapper/319:56:023
32388512112,5sleep30-21swapper/319:50:013
32388512112,5sleep30-21swapper/319:50:013
32190522112,5sleep30-21swapper/319:30:023
32179082112,5sleep30-21swapper/319:26:123
34525312102,5sleep30-21swapper/300:33:043
34468002102,5sleep30-21swapper/300:20:283
34411652102,5sleep30-21swapper/300:10:043
34133352102,5sleep30-21swapper/323:20:043
33964682102,5sleep30-21swapper/322:51:393
33908292102,5sleep30-21swapper/322:40:363
33849802102,5sleep30-21swapper/322:30:043
33794752102,5sleep30-21swapper/322:20:453
33630162103,4sleep30-21swapper/321:56:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional