You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-18 - 15:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sat Apr 18, 2026 12:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
338626421560,4sleep3481ktimers/307:55:013
338626421560,4sleep3481ktimers/307:55:013
3339610995449,4cyclictest3287753-21kworker/u8:2+flush-8:007:21:301
34301292530,1chrt3430130-21/usr/sbin/munin08:36:292
3339610995042,6cyclictest3643592-21kworker/u8:3+events_unbound12:21:231
34684042490,4chrt0-21swapper/209:16:222
3339610994940,7cyclictest3574913-21kworker/u8:0+flush-8:011:56:251
3339610994840,6cyclictest3529868-21kworker/u8:3+flush-8:011:16:241
3339610994739,6cyclictest3344498-21latency_hist07:15:011
3339610994738,7cyclictest3350564-21ntpq07:16:241
3339608994740,5cyclictest3499047-21ntpq09:46:220
3339608994638,6cyclictest3579648-21latency_hist11:10:010
3339610994540,4cyclictest3425746-21kworker/u8:0+flush-8:009:16:171
3339610994437,4cyclictest3425746-21kworker/u8:0+events_unbound09:41:231
3339610994436,5cyclictest3287753-21kworker/u8:2+events_unbound07:26:251
3339608994434,8cyclictest3548747-21ntpq10:36:220
3339610994333,8cyclictest3633431-21ntpq12:01:231
3339610994333,8cyclictest3633431-21ntpq12:01:221
3339608994334,6cyclictest3475256-21latency_hist09:25:010
3339613994233,7cyclictest280-21systemd-journal10:53:402
3339610994235,5cyclictest3339488-21kworker/u8:0+flush-8:007:51:261
3339610994235,5cyclictest3339488-21kworker/u8:0+flush-8:007:51:261
3339610994235,4cyclictest3629565-21kworker/u8:2+flush-8:012:11:201
3339610994233,7cyclictest3464474-21ntpq09:11:241
3339610994229,9cyclictest280-21systemd-journal08:14:401
3339608994234,6cyclictest3298041-21kworker/u8:3+flush-8:007:11:120
333477224228,9sleep10-21swapper/107:05:031
3339613994132,7cyclictest280-21systemd-journal07:44:402
3339610994135,5cyclictest3564936-21kworker/u8:1+flush-8:011:36:231
3339610994134,5cyclictest3366086-21kworker/u8:3+flush-8:008:41:261
333960899401,31cyclictest3334581-21kworker/0:2+events09:51:230
333960899401,31cyclictest3334581-21kworker/0:2+events09:51:230
3339610993933,4cyclictest3381143-21kworker/u8:1+flush-8:008:31:241
3339610993932,5cyclictest3366086-21kworker/u8:3+events_unbound10:01:221
3339610993930,6cyclictest3470350-21kworker/u8:2+flush-8:010:11:221
3339608993930,7cyclictest3648231-21ntpq12:16:240
3339613993829,7cyclictest280-21systemd-journal11:20:002
3339610993834,3cyclictest3366086-21kworker/u8:3+flush-8:008:51:161
3339610993832,4cyclictest3425746-21kworker/u8:0+flush-8:009:31:241
3339610993832,4cyclictest280-21systemd-journal12:29:501
3339608993829,7cyclictest3619735-21/usr/sbin/munin11:51:220
333960899381,35cyclictest3619445-21kworker/0:0+events11:58:010
33867982370,3sleep20-21swapper/207:56:162
33867982370,3sleep20-21swapper/207:56:162
3339613993732,3cyclictest3381143-21kworker/u8:1+flush-8:008:11:172
3339610993732,3cyclictest3549602-21kworker/u8:2+events_unbound10:56:171
3339610993731,4cyclictest280-21systemd-journal08:00:401
3339610993731,4cyclictest280-21systemd-journal08:00:391
3339610993730,5cyclictest3381143-21kworker/u8:1+flush-8:008:26:231
3339608993730,5cyclictest3599263-21grep11:26:290
3339608993730,5cyclictest280-21systemd-journal10:21:540
3339608993729,6cyclictest280-21systemd-journal09:00:000
3339608993729,6cyclictest280-21systemd-journal07:20:000
3339608993728,6cyclictest3381143-21kworker/u8:1+flush-8:008:16:120
3339610993630,4cyclictest3549602-21kworker/u8:2+flush-8:010:51:241
3339610993630,4cyclictest3529868-21kworker/u8:3+flush-8:010:21:151
3339610993629,5cyclictest3361637-21apt-get07:31:111
333960899362,28cyclictest3334581-21kworker/0:2+events08:01:110
333960899362,28cyclictest3334581-21kworker/0:2+events08:01:110
3339613993530,4cyclictest3564936-21kworker/u8:1+events_unbound11:21:332
3339613993529,4cyclictest3298041-21kworker/u8:3+flush-8:007:15:052
3339610993530,3cyclictest3339488-21kworker/u8:0+events_unbound08:06:291
3339610993529,4cyclictest3529868-21kworker/u8:3+flush-8:010:26:191
3339610993528,5cyclictest3649320-21kworker/u8:1+events_unbound12:31:251
3339610993527,6cyclictest3574913-21kworker/u8:0+flush-8:011:11:261
3339608993527,6cyclictest280-21systemd-journal10:41:560
333960899352,27cyclictest3334581-21kworker/0:2+events09:45:010
333960899351,32cyclictest3619445-21kworker/0:0+events12:32:170
3339613993425,7cyclictest280-21systemd-journal10:05:012
3339610993429,4cyclictest3425746-21kworker/u8:0+flush-8:008:46:261
3339610993428,4cyclictest3470773-21wget09:21:141
3339610993428,4cyclictest3339488-21kworker/u8:0+flush-8:007:41:291
3339610993428,4cyclictest3339488-21kworker/u8:0+flush-8:007:36:271
3339610993426,6cyclictest3529868-21kworker/u8:3+flush-8:011:51:231
3339610993423,8cyclictest280-21systemd-journal09:36:411
333960899347,23cyclictest3334581-21kworker/0:2+events09:25:170
333960899343,29cyclictest3334581-21kworker/0:2+events08:51:130
3339608993427,5cyclictest3514750-21apt-get10:05:000
3339608993425,7cyclictest3520521-21diskstats10:11:120
333960899342,30cyclictest3334581-21kworker/0:2+events09:56:270
333960899342,26cyclictest3334581-21kworker/0:2+events07:20:470
333960899341,31cyclictest3554602-21kworker/0:2+events10:51:100
3339608993412,20cyclictest3534836-21kworker/0:1+events10:31:150
3339608993410,22cyclictest3334581-21kworker/0:2+events09:10:010
3339608993410,22cyclictest3334581-21kworker/0:2+events08:35:010
3339608993410,22cyclictest3334581-21kworker/0:2+events07:51:130
3339608993410,22cyclictest3334581-21kworker/0:2+events07:51:120
35817262330,2sleep30-21swapper/311:11:203
3339610993328,4cyclictest3564936-21kworker/u8:1+flush-8:012:06:281
3339610993328,3cyclictest3366086-21kworker/u8:3+flush-8:008:21:341
3339610993327,5cyclictest3366086-21kworker/u8:3+events_unbound09:06:251
3339610993326,5cyclictest3287753-21kworker/u8:2+flush-8:007:46:191
3339608993327,4cyclictest3339488-21kworker/u8:0+flush-8:007:41:270
3339608993322,9cyclictest3469451-21ntpq09:16:250
333960899332,29cyclictest3334581-21kworker/0:2+events08:21:270
333960899331,31cyclictest3619445-21kworker/0:0+events12:09:490
3339608993310,22cyclictest3619445-21kworker/0:0+events12:30:000
3339613993227,3cyclictest3604241-21unixbench_singl11:31:312
3339613993226,4cyclictest3505088-21kworker/u8:1+events_unbound10:21:272
3339610993227,3cyclictest3410994-21munin-run08:20:011
3339610993226,4cyclictest3470350-21kworker/u8:2+flush-8:009:26:261
3339610993224,6cyclictest3599954-21/usr/sbin/munin11:31:231
3339610993222,8cyclictest3668005-21ntpq12:36:231
3339608993226,4cyclictest3569680-21munin-run11:00:000
333960899322,29cyclictest3534836-21kworker/0:1+events10:46:350
333960899322,26cyclictest3554602-21kworker/0:2+events11:20:290
333960899322,25cyclictest3334581-21kworker/0:2+events09:00:230
33393122324,9sleep20-21swapper/207:08:292
3339613993127,3cyclictest3470350-21kworker/u8:2+events_unbound09:46:262
3339613993124,5cyclictest280-21systemd-journal09:30:002
3339613993121,7cyclictest280-21systemd-journal10:00:002
3339610993127,3cyclictest3574913-21kworker/u8:0+flush-8:011:41:191
3339610993126,3cyclictest3649115-21systemd-run12:20:011
3339610993125,4cyclictest3529868-21kworker/u8:3+flush-8:011:01:241
3339610993125,4cyclictest3366086-21kworker/u8:3+events_unbound08:56:211
3339610993124,5cyclictest3575007-21apt-get11:06:101
3339610993124,5cyclictest3549602-21kworker/u8:2+events_unbound10:46:261
333960899317,22cyclictest3554602-21kworker/0:2+events11:15:010
333960899312,27cyclictest3609553-21kworker/0:1+events11:46:130
333960899312,27cyclictest3554602-21kworker/0:2+events11:36:210
333960899312,27cyclictest3554602-21kworker/0:2+events11:16:210
3339613993025,4cyclictest3549602-21kworker/u8:2+flush-8:010:40:012
3339610993025,3cyclictest3366086-21kworker/u8:3+events_unbound10:06:301
3339610993024,4cyclictest3574913-21kworker/u8:0+flush-8:011:46:281
3339610993024,4cyclictest3529868-21kworker/u8:3+flush-8:010:41:311
3339610993023,5cyclictest3529868-21kworker/u8:3+events_unbound10:36:261
3339610993021,7cyclictest3529826-21latency_hist10:20:011
3339610993020,7cyclictest280-21systemd-journal08:00:001
3339610993020,7cyclictest280-21systemd-journal08:00:001
3339608993023,5cyclictest3610458-21sort11:41:160
3339608993023,5cyclictest3339488-21kworker/u8:0+flush-8:007:31:260
333960899302,26cyclictest3554602-21kworker/0:2+events11:01:150
333960899302,26cyclictest3334581-21kworker/0:2+events07:46:190
3339608993017,11cyclictest3416802-21sort08:26:150
333960899301,28cyclictest3334581-21kworker/0:2+events08:11:130
333960899301,27cyclictest3334581-21kworker/0:2+events09:36:110
333960899301,27cyclictest3334581-21kworker/0:2+events09:31:200
333960899301,27cyclictest3334581-21kworker/0:2+events08:36:270
333960899301,27cyclictest3334581-21kworker/0:2+events07:36:250
3339613992925,2cyclictest3441147-21aten2_r5power_v08:51:142
3339613992925,2cyclictest3366631-21aten2_r5power_e07:36:142
3339613992923,4cyclictest3629565-21kworker/u8:2+flush-8:012:16:312
3339613992923,4cyclictest3629565-21kworker/u8:2+events_unbound12:11:262
3339613992922,5cyclictest280-21systemd-journal10:13:402
3339610992922,5cyclictest3500275-21apt-get09:51:211
3339610992922,5cyclictest3500275-21apt-get09:51:201
333960899298,19cyclictest3334581-21kworker/0:2+events10:06:210
3339608992923,4cyclictest3604595-21systemd-run11:35:000
3339608992910,17cyclictest3334581-21kworker/0:2+events07:56:210
3339608992910,17cyclictest3334581-21kworker/0:2+events07:56:210
333961399284,3cyclictest35796602dpkg11:10:002
3339613992823,4cyclictest3549602-21kworker/u8:2+flush-8:010:46:192
3339613992821,5cyclictest280-21systemd-journal11:40:002
3339610992823,3cyclictest3450898-21apt-get09:01:101
3339610992821,5cyclictest3529868-21kworker/u8:3+flush-8:011:26:271
333960899284,19cyclictest3619445-21kworker/0:0+events12:35:090
3339608992824,3cyclictest3440687-21cron08:50:000
3339608992817,9cyclictest280-21systemd-journal10:20:010
3339608992812,15cyclictest3334581-21kworker/0:2+events08:41:140
333960899280,27cyclictest3619445-21kworker/0:0+events12:25:010
35688162270,7sleep3451irq_work/310:56:233
333961399278,3cyclictest36174562kthreadcore11:46:192
3339613992722,3cyclictest3360962-21unixbench_singl07:26:302
3339610992723,3cyclictest3381143-21kworker/u8:1+events_unbound08:36:281
333960899279,16cyclictest3619445-21kworker/0:0+events12:11:210
333960899278,14cyclictest3619445-21kworker/0:0+events12:00:050
333960899278,14cyclictest3619445-21kworker/0:0+events12:00:050
3339608992724,2cyclictest3361318-21systemd-run07:30:000
3339608992710,15cyclictest3334581-21kworker/0:2+events08:06:270
33348612273,7sleep00-21swapper/007:06:110
3339610992618,5cyclictest3594881-21grep11:25:011
3339608992610,14cyclictest3334581-21kworker/0:2+events10:26:110
33496202250,2sleep3471rcuc/307:16:203
3339613992522,2cyclictest3515349-21aten2_r5power_c10:06:112
3339613992520,3cyclictest3381576-21aten2_r5power_v07:51:142
3339613992520,3cyclictest3381576-21aten2_r5power_v07:51:142
3339613992514,9cyclictest3454593-21ntpq09:01:232
3339610992521,3cyclictest3535029-21kworker/u8:0+events_unbound10:31:241
333960899255,19cyclictest3334581-21kworker/0:2+events09:14:010
3339613992420,3cyclictest3580535-21fschecks_time11:11:152
3339613992420,2cyclictest3664288-21aten2_r5power_c12:36:122
3339613992420,2cyclictest3624983-21fschecks_count11:56:142
3339613992420,2cyclictest3485522-21aten2_r5power_e09:36:122
3339613992419,3cyclictest3634827-21cpuspeed_turbos12:06:122
333961399241,6cyclictest3568844-21ntpq10:56:232
3339610992420,2cyclictest3506120-21kthreadcore09:56:201
3339613992319,2cyclictest3540383-21fschecks_count10:31:152
3339613992318,3cyclictest3654618-21tr12:26:132
3339613992318,3cyclictest0-21swapper/209:15:002
3339610992319,2cyclictest0-21swapper/109:46:121
3339613992219,2cyclictest3659378-21aten2_r5power_e12:31:112
3339613992214,6cyclictest280-21systemd-journal11:05:002
333961399212,13cyclictest3649428-21apt-get12:21:122
3339613992116,4cyclictest3381143-21kworker/u8:1+flush-8:008:16:322
3339613992112,7cyclictest280-21systemd-journal07:35:002
333961399204,4cyclictest0-21swapper/210:26:332
3339613992016,2cyclictest0-21swapper/209:55:002
3339613992016,2cyclictest0-21swapper/209:55:002
333961399193,13cyclictest3417505-21cut08:26:172
333961399192,12cyclictest3549985-21apt-get10:41:132
333961399192,12cyclictest3376507-21apt-get07:46:132
3339613991916,2cyclictest3411426-21aten2_r5power_p08:21:132
3339613991915,3cyclictest3470350-21kworker/u8:2+flush-8:009:21:422
3339613991915,2cyclictest3490642-21cpuspeed_turbos09:41:142
3339613991915,2cyclictest0-21swapper/208:05:012
3339613991915,2cyclictest0-21swapper/208:05:012
3339613991912,5cyclictest280-21systemd-journal09:00:002
33345532193,7sleep30-21swapper/307:05:013
333961399181,4cyclictest0-21swapper/209:10:012
3339613991814,2cyclictest3484216-21needreboot09:31:212
3339613991813,3cyclictest0-21swapper/207:11:202
333961399174,11cyclictest3621469-21tr11:51:192
3339613991713,2cyclictest0-21swapper/208:06:132
3339613991713,2cyclictest0-21swapper/207:21:222
3339613991712,2cyclictest3528192-21kthreadcore10:16:202
333961399162,2cyclictest0-21swapper/211:41:042
333961399162,2cyclictest0-21swapper/211:28:252
333961399162,13cyclictest0-21swapper/212:00:502
333961399162,13cyclictest0-21swapper/212:00:502
3339613991613,2cyclictest0-21swapper/208:47:232
3339613991613,2cyclictest0-21swapper/208:33:202
3339613991612,2cyclictest3431481-21fschecks_time08:41:162
35088192142,8sleep30-21swapper/309:56:253
34645192142,8sleep30-21swapper/309:11:263
34486302140,2sleep375-21kworker/3:1+events08:56:203
34117972142,8sleep30-21swapper/308:21:183
36531712132,7sleep30-21swapper/312:21:233
36186932132,7sleep30-21swapper/311:46:283
36097132132,6sleep30-21swapper/311:40:023
35986362132,7sleep30-21swapper/311:26:213
35860592133,6sleep30-21swapper/311:16:173
35348172132,6sleep30-21swapper/310:25:013
33557822132,7sleep30-21swapper/307:21:313
36400322122,6sleep30-21swapper/312:11:203
36202432122,6sleep30-21swapper/311:51:173
35947182122,5sleep30-21swapper/311:25:013
35796362120,8sleep30-21swapper/311:10:003
35720632122,6sleep30-21swapper/311:01:213
35595642122,6sleep30-21swapper/310:50:023
35554162122,6sleep30-21swapper/310:46:173
35535752122,6sleep30-21swapper/310:41:233
35483922122,6sleep30-21swapper/310:36:213
35444722122,6sleep30-21swapper/310:32:403
35301822122,6sleep30-21swapper/310:21:123
35290662122,6sleep30-21swapper/310:16:273
35107202122,6sleep30-21swapper/310:01:183
34940832122,6sleep30-21swapper/309:41:243
34857062120,8sleep30-21swapper/309:36:143
34810072122,6sleep30-21swapper/309:31:163
34724422122,6sleep30-21swapper/309:21:213
34658752123,5sleep30-21swapper/309:16:163
34455922122,6sleep30-21swapper/308:55:013
34357872122,5sleep30-21swapper/308:45:023
34311002122,6sleep30-21swapper/308:40:403
33862642122,6sleep30-21swapper/307:55:023
33862642122,6sleep30-21swapper/307:55:023
33712042122,5sleep30-21swapper/307:40:013
33613392122,5sleep30-21swapper/307:30:023
33605712122,6sleep30-21swapper/307:26:283
33407332122,6sleep30-21swapper/307:11:203
36655532112,5sleep30-21swapper/312:36:203
36590082112,5sleep30-21swapper/312:30:023
36449252112,5sleep30-21swapper/312:16:173
36382922112,5sleep30-21swapper/312:06:223
36295832112,6sleep30-21swapper/312:00:403
36295832112,6sleep30-21swapper/312:00:393
36249432112,5sleep30-21swapper/311:56:153
36094472112,5sleep30-21swapper/311:39:223
36045592113,5sleep30-21swapper/311:34:563
35211582112,5sleep30-21swapper/310:11:173
35156632112,6sleep30-21swapper/310:06:163
35002792112,5sleep30-21swapper/309:51:233
35002792112,5sleep30-21swapper/309:51:233
34950072112,5sleep30-21swapper/309:45:013
34754822112,5sleep30-21swapper/309:25:023
34569502112,5sleep30-21swapper/309:06:193
34508702112,5sleep30-21swapper/309:01:113
34260762112,5sleep30-21swapper/308:35:023
34250212112,5sleep30-21swapper/308:31:253
34167292112,5sleep30-21swapper/308:26:163
34067792112,5sleep30-21swapper/308:16:163
34014912112,5sleep30-21swapper/308:11:153
33965222112,5sleep30-21swapper/308:06:133
33934032112,5sleep30-21swapper/308:01:203
33934032112,5sleep30-21swapper/308:01:193
33764792112,5sleep30-21swapper/307:46:113
33716062112,5sleep30-21swapper/307:41:133
36542752102,5sleep30-21swapper/312:25:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional