You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-23 - 13:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Thu Apr 23, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
63559821130,1sleep0635602-21grep00:11:140
63559821130,1sleep0635602-21grep00:11:140
61026021000,3chrt75-21kworker/3:1-events23:46:133
5697552660,5sleep375-21kworker/3:1-events23:05:003
335221996258,3cyclictest342237-21kworker/u8:2+events_unbound20:20:001
335216995951,5cyclictest280-21systemd-journal21:06:100
335221995850,6cyclictest624413-21kworker/u8:1+flush-8:000:36:261
335221995850,6cyclictest381282-21kworker/u8:3+flush-8:021:26:201
335221995749,6cyclictest3704593-21kworker/u8:1+flush-8:019:51:201
335216995651,3cyclictest335069-21kworker/u8:0+events_unbound19:56:120
335216995545,7cyclictest560412-21diskstats22:56:110
3462422530,3sleep2371rcuc/219:16:222
335226995347,4cyclictest500711-21kworker/u8:2+flush-8:022:01:242
335226995347,4cyclictest500711-21kworker/u8:2+flush-8:022:01:232
335226995248,3cyclictest510579-21kworker/u8:3+flush-8:022:31:262
335221995147,3cyclictest430972-21kworker/u8:1+events_unbound22:01:101
335221995147,3cyclictest430972-21kworker/u8:1+events_unbound22:01:101
335221995147,3cyclictest335069-21kworker/u8:0+events_unbound19:26:091
335221995146,4cyclictest438647-21kworker/u8:0+events_unbound21:21:251
335221995146,4cyclictest430972-21kworker/u8:1+events_unbound20:56:091
335221995143,6cyclictest619400-21latency_hist23:55:011
335221995139,9cyclictest375756-21ntpq19:46:191
335221995045,4cyclictest335069-21kworker/u8:0+events_unbound20:21:101
335221995043,5cyclictest335069-21kworker/u8:0+events_unbound19:21:221
335216995041,7cyclictest461229-21/usr/sbin/munin21:16:190
335216994944,4cyclictest342237-21kworker/u8:2+flush-8:019:16:220
5321432480,3sleep2371rcuc/222:26:152
335221994843,4cyclictest624413-21kworker/u8:1+flush-8:000:01:111
335221994843,4cyclictest500711-21kworker/u8:2+events_unbound22:16:191
335221994842,4cyclictest430972-21kworker/u8:1+events_unbound21:11:231
335221994741,4cyclictest624413-21kworker/u8:1+flush-8:000:31:121
335221994740,5cyclictest544148-21kworker/u8:0+events_unbound23:11:201
335221994739,6cyclictest557712-21kworker/u8:3+flush-8:023:31:221
335221994642,3cyclictest430972-21kworker/u8:1+events_unbound21:06:241
335221994642,3cyclictest381282-21kworker/u8:3+events_unbound21:41:081
335216994636,8cyclictest280-21systemd-journal22:50:000
335216994630,13cyclictest280-21systemd-journal19:39:100
335221994541,3cyclictest544148-21kworker/u8:0+events_unbound23:25:001
335221994540,4cyclictest381282-21kworker/u8:3+flush-8:021:16:211
335221994540,3cyclictest335069-21kworker/u8:0+events_unbound19:41:131
335221994539,5cyclictest430972-21kworker/u8:1+flush-8:021:51:191
335221994538,5cyclictest544148-21kworker/u8:0+events_unbound23:01:111
335221994538,5cyclictest381282-21kworker/u8:3+flush-8:020:26:141
335221994536,7cyclictest558955-21ntpq22:51:191
335216994538,5cyclictest430972-21kworker/u8:1+flush-8:021:46:240
335216994533,9cyclictest624380-40logrotate00:00:000
335221994439,4cyclictest557712-21kworker/u8:3+flush-8:023:46:131
335221994439,4cyclictest430972-21kworker/u8:1+flush-8:021:46:201
335221994439,4cyclictest3704593-21kworker/u8:1+flush-8:019:36:211
335226994337,4cyclictest335069-21kworker/u8:0+flush-8:019:41:222
335221994338,4cyclictest624413-21kworker/u8:1+events_unbound00:06:211
335221994338,3cyclictest490638-21kworker/u8:0+events_unbound22:26:101
335221994337,4cyclictest557712-21kworker/u8:3+flush-8:023:16:161
335221994336,4cyclictest342237-21kworker/u8:2+flush-8:020:01:181
335226994236,4cyclictest438647-21kworker/u8:0+flush-8:020:56:192
335226994234,6cyclictest520574-21apt-get22:16:072
335221994237,4cyclictest557712-21kworker/u8:3+flush-8:023:41:251
335221994236,5cyclictest500711-21kworker/u8:2+events_unbound22:11:251
335221994236,5cyclictest381282-21kworker/u8:3+events_unbound21:36:221
335216994237,4cyclictest557712-21kworker/u8:3+flush-8:023:21:250
335221994137,3cyclictest335069-21kworker/u8:0+events_unbound20:36:261
335221994136,4cyclictest557712-21kworker/u8:3+flush-8:023:56:121
335221994136,3cyclictest544148-21kworker/u8:0+flush-8:023:26:261
335221994135,4cyclictest490638-21kworker/u8:0+events_unbound21:56:231
335221994135,4cyclictest3704593-21kworker/u8:1+flush-8:019:11:251
335221994135,4cyclictest335069-21kworker/u8:0+flush-8:020:31:211
335221994035,3cyclictest342237-21kworker/u8:2+flush-8:020:46:301
335221994034,4cyclictest500711-21kworker/u8:2+events_unbound22:46:231
335221994033,5cyclictest557712-21kworker/u8:3+flush-8:022:56:201
335221993934,4cyclictest335069-21kworker/u8:0+flush-8:019:31:171
335221993931,6cyclictest557712-21kworker/u8:3+flush-8:000:21:201
335216993935,3cyclictest342237-21kworker/u8:2+flush-8:020:01:130
335216993930,6cyclictest425994-21latency_hist20:40:010
335226993823,4cyclictest535317-21kworker/u8:1+flush-8:023:06:252
335221993833,4cyclictest500711-21kworker/u8:2+events_unbound22:06:231
335216993831,5cyclictest280-21systemd-journal20:29:110
335216993827,8cyclictest574693-21apt-get23:10:010
335226993731,4cyclictest604828-21kworker/u8:0+flush-8:023:41:272
335221993732,4cyclictest342237-21kworker/u8:2+events_unbound20:41:111
335221993732,3cyclictest535317-21kworker/u8:1+flush-8:023:06:141
335221993732,3cyclictest342237-21kworker/u8:2+events_unbound20:06:301
335216993733,3cyclictest557712-21kworker/u8:3+events_unbound23:16:230
335216993727,7cyclictest361807-21latency_hist19:35:010
335221993629,5cyclictest342237-21kworker/u8:2+events_unbound19:16:081
335216993628,6cyclictest280-21systemd-journal21:25:000
3349942364,11sleep10-21swapper/119:09:321
335226993531,2cyclictest633954-21kworker/u8:2+events_unbound00:16:272
335221993530,4cyclictest535317-21kworker/u8:1+flush-8:023:36:221
335221993529,5cyclictest500711-21kworker/u8:2+flush-8:022:21:271
335221993528,5cyclictest342237-21kworker/u8:2+flush-8:020:11:211
335221993528,5cyclictest342237-21kworker/u8:2+flush-8:020:11:211
335216993530,4cyclictest430972-21kworker/u8:1+flush-8:021:11:110
335216993525,8cyclictest280-21systemd-journal00:26:200
335216993525,7cyclictest371694-21latency_hist19:45:010
335226993425,7cyclictest280-21systemd-journal23:30:002
335221993428,5cyclictest381282-21kworker/u8:3+flush-8:020:51:111
335221993428,4cyclictest633954-21kworker/u8:2+flush-8:000:16:161
335216993429,4cyclictest624413-21kworker/u8:1+flush-8:000:06:270
335216993428,4cyclictest500711-21kworker/u8:2+flush-8:022:06:270
335216993428,4cyclictest430972-21kworker/u8:1+events_unbound21:40:010
335216993427,5cyclictest500711-21kworker/u8:2+events_unbound22:21:250
335226993323,8cyclictest280-21systemd-journal21:54:592
335221993327,4cyclictest624413-21kworker/u8:1+flush-8:000:26:151
335221993327,4cyclictest438647-21kworker/u8:0+events_unbound21:01:161
335221993326,5cyclictest544148-21kworker/u8:0+flush-8:022:41:211
335216993327,5cyclictest557712-21kworker/u8:3+flush-8:000:31:200
335216993327,4cyclictest510373-21systemd-run22:05:000
335216993327,4cyclictest510373-21systemd-run22:04:590
335216993327,4cyclictest3704593-21kworker/u8:1+flush-8:019:51:270
335226993227,3cyclictest461284-21aten2_r5power_c21:16:092
335221993228,3cyclictest510579-21kworker/u8:3+events_unbound22:35:001
335221993228,3cyclictest430972-21kworker/u8:1+events_unbound21:31:161
335221993225,6cyclictest342237-21kworker/u8:2+flush-8:019:55:101
335216993228,3cyclictest342237-21kworker/u8:2+events_unbound20:25:010
335216993225,5cyclictest599627-21latency_hist23:35:010
335216993223,7cyclictest629346-21latency_hist00:05:000
335226993126,4cyclictest381282-21kworker/u8:3+events_unbound21:41:272
335226993121,8cyclictest280-21systemd-journal20:26:102
335221993123,6cyclictest633954-21kworker/u8:2+flush-8:000:11:221
335221993123,6cyclictest633954-21kworker/u8:2+flush-8:000:11:221
335216993127,3cyclictest510579-21kworker/u8:3+flush-8:022:36:270
335216993125,4cyclictest490638-21kworker/u8:0+events_unbound21:56:270
335226993025,4cyclictest557712-21kworker/u8:3+events_unbound22:51:232
335226993025,3cyclictest280-21systemd-journal19:55:002
335216993025,3cyclictest476142-21aten2_r5power_p21:31:090
335216993023,5cyclictest544148-21kworker/u8:0+flush-8:022:41:230
335216993023,5cyclictest417375-21kthreadcore20:31:150
335226992924,3cyclictest600177-21cpuspeed_turbos23:36:112
335221992924,3cyclictest545002-21systemd-run22:40:011
335216992925,3cyclictest544148-21kworker/u8:0+flush-8:023:11:120
335216992925,3cyclictest500711-21kworker/u8:2+events_unbound22:30:010
335216992925,3cyclictest342237-21kworker/u8:2+flush-8:020:11:250
335216992925,3cyclictest342237-21kworker/u8:2+flush-8:020:11:240
335216992924,4cyclictest381282-21kworker/u8:3+flush-8:020:58:400
335216992924,3cyclictest557712-21kworker/u8:3+flush-8:000:21:260
335216992924,3cyclictest544148-21kworker/u8:0+events_unbound23:26:120
3373672280,2sleep00-21swapper/019:11:140
335226992824,3cyclictest342237-21kworker/u8:2+flush-8:020:46:152
335226992824,2cyclictest0-21swapper/221:10:002
335226992820,6cyclictest280-21systemd-journal19:36:102
335216992823,3cyclictest614493-21turbostat.cron23:50:000
335216992822,4cyclictest342237-21kworker/u8:2+events_unbound20:06:120
335216992822,4cyclictest280-21systemd-journal22:52:060
335216992822,4cyclictest280-21systemd-journal20:44:100
335216992821,5cyclictest335069-21kworker/u8:0+flush-8:019:26:190
3347772282,6sleep00-21swapper/019:06:420
33522699277,10cyclictest0-21swapper/222:11:242
335226992723,2cyclictest580274-21aten2_r5power_e23:16:082
335226992723,2cyclictest550331-21aten2_r5power_e22:46:112
335226992723,2cyclictest456587-21fschecks_count21:11:112
335226992723,2cyclictest0-21swapper/223:00:002
335226992722,3cyclictest280-21systemd-journal19:25:002
335216992722,4cyclictest430972-21kworker/u8:1+flush-8:021:51:290
335216992722,3cyclictest624413-21kworker/u8:1+events_unbound00:36:100
335216992722,3cyclictest438647-21kworker/u8:0+events_unbound21:01:200
335216992718,7cyclictest600192-21cpuspeed_turbos23:36:110
335216992718,2cyclictest421rcuog/223:51:110
335216992714,11cyclictest372380-21fschecks_time19:46:120
335226992621,4cyclictest406230-21idleruntime-cro20:20:002
335216992621,4cyclictest342237-21kworker/u8:2+flush-8:020:51:190
335216992621,3cyclictest381282-21kworker/u8:3+events_unbound21:26:250
335216992617,6cyclictest490625-21latency_hist21:45:010
335226992520,3cyclictest480695-21cron21:35:002
335226992519,4cyclictest589440-21unixbench_singl23:21:272
335226992519,4cyclictest535317-21kworker/u8:1+flush-8:022:36:222
335226992514,9cyclictest634544-21awk00:10:002
335226992512,8cyclictest525552-21apt-get22:21:072
335216992511,12cyclictest609530-21turbostat.cron23:45:000
3405712240,3sleep375-21kworker/3:1-mm_percpu_wq19:15:033
335226992421,2cyclictest400955-21unixbench_singl20:11:272
335226992421,2cyclictest400955-21unixbench_singl20:11:272
335226992420,3cyclictest466505-21fschecks_time21:21:122
335226992420,3cyclictest438647-21kworker/u8:0+events_unbound20:51:282
335226992419,3cyclictest0-21swapper/222:00:002
335216992420,3cyclictest500711-21kworker/u8:2+flush-8:022:16:250
335216992420,3cyclictest335069-21kworker/u8:0+flush-8:019:21:240
335216992415,7cyclictest644423-21cron00:20:000
335216992410,12cyclictest535775-21fschecks_time22:31:120
335226992320,2cyclictest406874-21fschecks_count20:21:112
335226992319,3cyclictest382120-21cpuspeed_turbos19:56:102
335226992319,2cyclictest421590-21cpuspeed_turbos20:36:102
335226992319,2cyclictest352582-21fschecks_time19:26:102
335226992317,4cyclictest430567-21unixbench_multi20:41:272
335226992317,4cyclictest342237-21kworker/u8:2+flush-8:019:46:162
335216992318,4cyclictest500711-21kworker/u8:2+flush-8:022:12:010
335226992219,2cyclictest629574-21latency_hist00:05:002
335226992218,2cyclictest579508-21unixbench_multi23:11:272
335226992217,3cyclictest357292-21aten2_r5power_p19:31:092
335226992216,4cyclictest450794-21turbostat.cron21:04:592
335226992216,4cyclictest421022-21cron20:35:012
335226992211,2cyclictest0-21swapper/223:46:132
335226992210,4cyclictest0-21swapper/220:01:202
335216992216,4cyclictest568848-21needreboot23:01:180
335226992117,3cyclictest490981-21aten2_r5power_c21:46:092
335216992117,3cyclictest401856-21cpuspeed_turbos20:16:100
335226992015,4cyclictest430972-21kworker/u8:1+events_unbound22:05:032
335226992011,7cyclictest595684-21sed23:31:142
335226992011,7cyclictest566416-21cut23:01:162
335226992011,6cyclictest659441-21sed00:35:012
33522699199,2cyclictest0-21swapper/222:41:092
33522699192,12cyclictest618588-21ntpq23:51:212
335226991916,2cyclictest392077-21fschecks_count20:06:132
335226991915,2cyclictest0-21swapper/221:35:512
335226991914,3cyclictest471341-21tr21:26:082
335226991913,4cyclictest624021-21unixbench_singl23:56:262
335226991911,6cyclictest650417-21sed00:26:142
3309132193,8sleep30-21swapper/319:06:123
33522699188,2cyclictest421rcuog/219:11:212
335226991810,6cyclictest649109-21seq00:21:342
33521699181,6cyclictest4350862sleep020:46:210
3343172183,9sleep20-21swapper/219:06:242
33522699178,7cyclictest662138-21tr00:36:172
33522699167,7cyclictest637438-21cut00:11:172
33522699167,7cyclictest637438-21cut00:11:162
4458022141,7sleep30-21swapper/321:00:013
6353592132,7sleep30-21swapper/300:11:143
6353592132,7sleep30-21swapper/300:11:143
6293352132,7sleep30-21swapper/300:05:003
5449462132,6sleep30-21swapper/322:40:003
4359502132,6sleep30-21swapper/320:50:023
4111872132,6sleep30-21swapper/320:25:023
3987642132,7sleep30-21swapper/320:11:183
3987642132,7sleep30-21swapper/320:11:183
6592872122,5sleep30-21swapper/300:35:023
6201582122,6sleep30-21swapper/323:56:143
6191042122,6sleep30-21swapper/323:51:283
6045662122,6sleep30-21swapper/323:40:003
5954942122,6sleep30-21swapper/323:31:143
5850042122,5sleep30-21swapper/323:20:023
5697552122,5sleep30-21swapper/323:05:013
5599442122,6sleep30-21swapper/322:55:023
5351142122,6sleep30-21swapper/322:30:023
5292182122,6sleep30-21swapper/322:21:183
5111632122,6sleep30-21swapper/322:06:143
5054042122,6sleep30-21swapper/322:00:003
4955722122,5sleep30-21swapper/321:50:013
4708002122,5sleep30-21swapper/321:25:013
4651992122,6sleep30-21swapper/321:16:263
4500632122,6sleep30-21swapper/321:01:263
4325062122,6sleep30-21swapper/320:46:173
4268502122,6sleep30-21swapper/320:41:153
4258332122,6sleep30-21swapper/320:38:103
4207322122,6sleep30-21swapper/320:31:273
4022092122,6sleep30-21swapper/320:16:153
3922432122,6sleep30-21swapper/320:06:163
3868542122,6sleep30-21swapper/320:01:103
3717122122,5sleep30-21swapper/319:45:003
3709432122,6sleep30-21swapper/319:41:243
3620222122,6sleep30-21swapper/319:35:023
3559982122,6sleep30-21swapper/319:26:193
3469462122,5sleep30-21swapper/319:20:013
3392102122,6sleep30-21swapper/319:11:183
6550002112,5sleep30-21swapper/300:31:133
6506032112,5sleep30-21swapper/300:26:143
6492972112,6sleep30-21swapper/300:24:023
6397932113,5sleep30-21swapper/300:16:003
6304272112,5sleep30-21swapper/300:06:173
5900252112,5sleep30-21swapper/323:25:393
5801282112,5sleep30-21swapper/323:15:163
5788792112,5sleep30-21swapper/323:11:193
5551602112,5sleep30-21swapper/322:50:373
5502762112,5sleep30-21swapper/322:46:113
5456862112,5sleep30-21swapper/322:41:143
5304792112,5sleep30-21swapper/322:26:093
5209992112,5sleep30-21swapper/322:16:143
5156312112,6sleep30-21swapper/322:11:043
5096682112,5sleep30-21swapper/322:01:253
5096682112,5sleep30-21swapper/322:01:253
4908852112,6sleep30-21swapper/321:45:363
4859412112,5sleep30-21swapper/321:40:463
4810422112,5sleep30-21swapper/321:36:083
4763052112,5sleep30-21swapper/321:31:113
4667152111,6sleep30-21swapper/321:21:153
4566962112,5sleep30-21swapper/321:11:133
4514592112,5sleep30-21swapper/321:06:113
4065022112,6sleep30-21swapper/320:20:243
3821822112,5sleep30-21swapper/319:56:133
3769342112,5sleep30-21swapper/319:51:073
3571282112,5sleep30-21swapper/319:30:293
6048252102,5sleep30-21swapper/323:40:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional