You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-24 - 09:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot3s.osadl.org (updated Fri Apr 24, 2026 00:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
124752236161,24sleep10-21swapper/119:09:401
121552204165,26sleep20-21swapper/219:05:292
122752202166,24sleep30-21swapper/319:07:033
122412201163,26sleep00-21swapper/019:06:370
2955421700,5sleep21259599cyclictest21:00:122
2196721680,4sleep31260199cyclictest00:20:273
1852521670,4sleep21259599cyclictest20:35:122
12595991080,106cyclictest0-21swapper/222:03:272
12595997571,3cyclictest0-21swapper/200:34:442
12595996057,2cyclictest0-21swapper/200:07:552
277882480,2sleep00-21swapper/022:10:010
184972470,3sleep118502-21unixbench_singl21:45:251
24552460,4sleep21274-21diskmemload21:10:202
12595994037,2cyclictest0-21swapper/220:57:382
1258499401,19cyclictest24587-21kworker/0:000:32:240
12601993824,8cyclictest0-21swapper/319:28:033
12601993423,3cyclictest0-21swapper/319:10:423
1258499335,13cyclictest13584-21munin-run00:05:010
12601993220,3cyclictest0-21swapper/320:42:103
1260199321,24cyclictest0-21swapper/323:24:353
1259599311,22cyclictest1274-21diskmemload23:35:022
1259599311,22cyclictest0-21swapper/220:46:252
1259599311,13cyclictest0-21swapper/222:34:202
1259599311,11cyclictest0-21swapper/221:18:372
1260199302,13cyclictest24508-21diskstats23:15:123
1260199301,12cyclictest0-21swapper/319:30:113
1259599301,13cyclictest0-21swapper/219:48:442
1259599301,11cyclictest0-21swapper/219:40:482
1259599301,11cyclictest0-21swapper/219:20:372
1259599301,10cyclictest0-21swapper/222:58:242
1259599300,28cyclictest0-21swapper/219:50:042
1259599300,23cyclictest0-21swapper/223:57:422
1259599300,23cyclictest0-21swapper/223:26:412
1259599300,23cyclictest0-21swapper/222:07:332
1258499304,12cyclictest18274-21idleruntime-cro20:35:020
1258499302,9cyclictest8252-21kworker/0:222:45:480
1258499302,11cyclictest3266-21kworker/0:221:30:380
1258499302,10cyclictest27994-21kworker/0:223:23:430
1258499301,27cyclictest25773-21kworker/0:023:26:470
1258499301,23cyclictest14209-21kworker/0:021:39:220
1258499301,12cyclictest32367-21kworker/0:123:45:230
1258499300,12cyclictest3266-21kworker/0:221:45:220
1260199291,12cyclictest0-21swapper/319:50:273
12595992926,2cyclictest32-21ksoftirqd/220:05:212
12595992926,2cyclictest32-21ksoftirqd/220:05:212
1259599291,9cyclictest0-21swapper/222:35:202
1259599291,12cyclictest0-21swapper/223:41:132
1259599291,12cyclictest0-21swapper/222:21:332
1259599291,11cyclictest20408-21df19:25:122
1259599291,10cyclictest0-21swapper/223:04:482
1259599290,13cyclictest0-21swapper/222:25:572
1259599290,13cyclictest0-21swapper/222:25:572
1259599290,12cyclictest0-21swapper/223:12:252
1259599290,11cyclictest0-21swapper/221:22:132
1259599290,10cyclictest0-21swapper/223:51:532
1258499292,10cyclictest27852-21kworker/0:120:59:070
1258499292,10cyclictest17370-21kworker/0:019:20:390
1258499291,11cyclictest20886-21kworker/0:222:03:270
1258499291,11cyclictest1015-21kworker/0:021:13:060
12601992817,3cyclictest0-21swapper/323:10:513
1260199281,13cyclictest0-21swapper/323:01:073
1260199281,12cyclictest8258-21ntp_states23:50:223
1260199281,11cyclictest0-21swapper/322:06:593
1260199280,21cyclictest0-21swapper/300:10:483
1260199280,12cyclictest0-21swapper/323:44:113
1259599281,9cyclictest0-21swapper/220:27:452
1259599281,13cyclictest0-21swapper/219:13:292
1259599281,12cyclictest0-21swapper/222:19:012
1259599281,12cyclictest0-21swapper/219:38:482
1259599281,11cyclictest0-21swapper/220:31:532
1259599281,11cyclictest0-21swapper/220:02:002
1259599281,10cyclictest0-21swapper/221:58:412
1259599281,10cyclictest0-21swapper/219:19:212
1259599280,26cyclictest0-21swapper/221:26:572
1259599280,20cyclictest0-21swapper/222:43:282
1259599280,12cyclictest0-21swapper/223:21:292
1259599280,12cyclictest0-21swapper/221:52:572
1259199281,10cyclictest0-21swapper/123:46:301
1258499283,12cyclictest28631-21munin-run19:45:010
1258499282,9cyclictest9328-21kworker/0:020:23:350
1258499282,11cyclictest7752-21kworker/0:021:26:260
1258499282,10cyclictest361-21kworker/0:019:55:470
1258499281,9cyclictest30533-21kworker/0:221:04:060
1258499281,22cyclictest11263-21kworker/0:000:16:470
1258499281,18cyclictest8252-21kworker/0:222:54:280
1258499281,18cyclictest4874-21kworker/0:120:25:390
1258499281,12cyclictest4515-21kworker/0:223:53:230
1258499281,11cyclictest8252-21kworker/0:222:55:590
1258499280,12cyclictest28634-21kworker/0:200:36:320
1260199271,14cyclictest0-21swapper/323:32:433
1260199271,12cyclictest0-21swapper/323:58:283
1260199271,11cyclictest0-21swapper/323:47:483
1260199271,11cyclictest0-21swapper/322:31:083
1260199271,11cyclictest0-21swapper/322:15:233
1260199271,11cyclictest0-21swapper/321:30:313
1260199271,10cyclictest0-21swapper/319:36:353
12601992710,3cyclictest0-21swapper/321:01:543
1259599271,9cyclictest0-21swapper/220:22:562
1259599271,11cyclictest0-21swapper/222:53:042
1259599271,11cyclictest0-21swapper/222:45:562
1259599271,11cyclictest0-21swapper/222:10:212
1259599271,11cyclictest0-21swapper/220:44:492
1259599271,11cyclictest0-21swapper/200:11:422
1259599270,9cyclictest0-21swapper/223:46:302
1259599270,10cyclictest0-21swapper/220:51:452
1258499277,4cyclictest28305-21kworker/0:323:30:120
1258499272,9cyclictest19976-21kworker/0:219:29:310
1258499272,16cyclictest19255-21kworker/0:123:14:200
1258499272,10cyclictest2310-21kworker/0:023:41:470
1258499271,12cyclictest17448-21cat00:10:250
1258499271,10cyclictest20351-21kworker/0:120:41:590
28532260,2sleep11259199cyclictest23:40:121
226242260,5sleep322601-21/usr/sbin/munin00:25:133
1260199268,2cyclictest0-21swapper/300:08:443
1260199267,3cyclictest0-21swapper/321:52:033
1260199267,3cyclictest0-21swapper/319:56:513
12601992615,3cyclictest0-21swapper/322:46:233
12601992613,7cyclictest0-21swapper/320:52:383
12601992612,8cyclictest0-21swapper/321:05:543
12601992612,8cyclictest0-21swapper/320:47:143
1260199261,11cyclictest0-21swapper/321:43:393
1260199261,11cyclictest0-21swapper/319:18:033
1259599268,9cyclictest0-21swapper/200:35:052
1259599260,11cyclictest0-21swapper/223:15:452
1259599260,11cyclictest0-21swapper/221:49:572
1259599260,11cyclictest0-21swapper/200:18:332
12591992615,3cyclictest28538-21head00:35:271
1258499262,9cyclictest22047-21kworker/0:100:24:150
1258499262,9cyclictest20886-21kworker/0:221:57:550
1258499261,9cyclictest5531-21kworker/0:121:19:140
1258499261,9cyclictest3266-21kworker/0:221:41:220
12584992616,2cyclictest19255-21kworker/0:123:15:160
1258499261,11cyclictest22047-21kworker/0:100:28:240
1258499261,11cyclictest17959-21kworker/0:220:52:030
1258499261,11cyclictest14209-21kworker/0:021:50:060
12601992511,8cyclictest0-21swapper/320:10:473
1260199251,10cyclictest0-21swapper/322:39:243
1260199251,10cyclictest0-21swapper/319:47:273
12601992510,3cyclictest0-21swapper/320:04:553
1260199250,12cyclictest0-21swapper/320:09:233
1260199250,12cyclictest0-21swapper/320:09:233
1259599251,9cyclictest0-21swapper/200:26:542
1259599251,8cyclictest0-21swapper/219:55:442
1259599251,8cyclictest0-21swapper/200:04:302
1259599251,10cyclictest1274-21diskmemload21:31:012
1259599251,10cyclictest0-21swapper/221:41:252
1259599250,13cyclictest0-21swapper/221:38:532
1259599250,11cyclictest21462-21ntpq00:20:222
1259599250,11cyclictest0-21swapper/223:35:422
1259599250,11cyclictest0-21swapper/223:35:422
1259599250,10cyclictest0-21swapper/223:08:452
1259599250,10cyclictest0-21swapper/220:11:242
1259199252,16cyclictest0-21swapper/123:00:581
1258499252,9cyclictest3778-21kworker/0:222:27:510
1258499252,9cyclictest3778-21kworker/0:222:27:510
1258499251,9cyclictest26110-21kworker/0:119:38:390
1258499251,9cyclictest14438-21kworker/0:119:17:460
12584992513,3cyclictest4874-21kworker/0:120:02:510
1258499251,14cyclictest27931-21kworker/0:022:23:110
1258499251,11cyclictest11658-21idleruntime-cro20:20:010
1258499251,10cyclictest6017-21kworker/0:122:38:520
1260199249,3cyclictest0-21swapper/323:29:183
1260199248,3cyclictest0-21swapper/320:28:503
1260199246,9cyclictest0-21swapper/320:17:183
1260199245,3cyclictest0-21swapper/319:22:593
1260199241,7cyclictest0-21swapper/321:13:193
12601992413,3cyclictest0-21swapper/320:22:583
1260199241,11cyclictest0-21swapper/300:37:243
1260199241,11cyclictest0-21swapper/300:33:243
1260199241,10cyclictest0-21swapper/319:41:113
1260199240,9cyclictest0-21swapper/321:20:253
1259599240,11cyclictest0-21swapper/219:30:372
1259199241,6cyclictest0-21swapper/122:52:311
1259199241,16cyclictest0-21swapper/121:30:291
12591992410,6cyclictest3465-21kworker/u8:220:15:321
1259199240,7cyclictest0-21swapper/123:35:491
1259199240,7cyclictest0-21swapper/123:35:491
1258499247,2cyclictest27931-21kworker/0:022:15:390
1258499246,2cyclictest3266-21kworker/0:221:21:420
1258499242,11cyclictest11263-21kworker/0:000:07:030
1258499241,9cyclictest6017-21kworker/0:122:33:240
1258499241,22cyclictest23874-21kworker/0:019:33:310
1260199239,3cyclictest0-21swapper/322:27:563
1260199239,3cyclictest0-21swapper/322:27:563
1260199239,3cyclictest0-21swapper/322:03:353
1260199237,9cyclictest0-21swapper/320:38:463
1260199231,11cyclictest0-21swapper/323:07:233
1259199237,14cyclictest3465-21kworker/u8:220:12:161
1259199232,18cyclictest8616-21cut22:40:011
1259199231,5cyclictest23-21ksoftirqd/123:22:051
1259199231,18cyclictest7525-21df23:50:141
1259199231,15cyclictest0-21swapper/122:15:161
1259199231,15cyclictest0-21swapper/100:25:001
1259199231,11cyclictest0-21swapper/122:25:331
1259199231,11cyclictest0-21swapper/122:25:331
1258499232,9cyclictest28320-21kworker/0:219:45:070
1258499231,16cyclictest20351-21kworker/0:120:46:110
1258499231,10cyclictest21596-21kworker/0:323:08:230
12584992310,3cyclictest20886-21kworker/0:222:12:390
1260199229,3cyclictest0-21swapper/322:52:443
1260199229,3cyclictest0-21swapper/322:13:313
1260199226,3cyclictest0-21swapper/322:43:563
1260199226,3cyclictest0-21swapper/320:33:423
1260199225,3cyclictest0-21swapper/322:56:123
1260199221,12cyclictest0-21swapper/321:36:113
1259599221,10cyclictest0-21swapper/220:16:062
1259199221,6cyclictest0-21swapper/122:20:331
1259199221,16cyclictest0-21swapper/123:55:481
1258499228,3cyclictest6017-21kworker/0:122:40:520
1258499227,2cyclictest361-21kworker/0:019:54:470
1258499224,6cyclictest17959-21kworker/0:220:35:030
1258499221,5cyclictest0-21swapper/023:03:080
1258499221,12cyclictest28305-21kworker/0:323:35:100
1258499221,12cyclictest28305-21kworker/0:323:35:100
1258499221,12cyclictest14438-21kworker/0:119:12:190
1260199219,3cyclictest0-21swapper/321:27:193
1260199217,3cyclictest0-21swapper/321:46:273
1260199216,3cyclictest0-21swapper/300:01:003
1260199215,3cyclictest0-21swapper/323:36:203
1260199215,3cyclictest0-21swapper/323:36:193
1260199215,2cyclictest12050irq/123-ahci[0021:20:013
12601992113,3cyclictest0-21swapper/320:55:023
1259199213,9cyclictest23-21ksoftirqd/122:05:001
1259199212,15cyclictest0-21swapper/122:56:471
1259199212,14cyclictest0-21swapper/100:04:131
12591992117,3cyclictest0-21swapper/119:28:231
1259199211,17cyclictest0-21swapper/122:10:171
1259199211,15cyclictest9-21rcu_preempt23:10:271
1259199211,15cyclictest0-21swapper/122:30:181
1259199211,11cyclictest25074-21memory23:15:181
1259199211,11cyclictest16014-21/usr/sbin/munin00:10:251
1259199210,6cyclictest0-21swapper/122:09:251
1258499217,2cyclictest27852-21kworker/0:121:09:540
1258499212,7cyclictest9010-21kworker/0:123:55:420
1258499212,18cyclictest7095-21kworker/0:220:09:150
1258499212,18cyclictest7095-21kworker/0:220:09:150
1260199207,3cyclictest0-21swapper/300:17:483
1259599201,7cyclictest0-21swapper/221:06:172
1259199209,3cyclictest22608-21/usr/sbin/munin19:30:121
1259199206,9cyclictest0-21swapper/121:10:191
1259199202,16cyclictest0-21swapper/120:55:351
1259199202,16cyclictest0-21swapper/120:46:151
1259199202,10cyclictest21-21rcuc/121:25:251
1259199201,9cyclictest0-21swapper/120:35:021
1259199201,6cyclictest0-21swapper/121:23:171
12591992016,3cyclictest0-21swapper/121:03:521
12591992013,4cyclictest12005-21grep20:20:131
1259199201,2cyclictest32604-21kworker/u8:200:15:261
1259199201,15cyclictest0-21swapper/122:42:021
1259199201,15cyclictest0-21swapper/121:53:201
1259199201,14cyclictest0-21swapper/100:27:231
1259199201,14cyclictest0-21swapper/100:09:241
1259199201,11cyclictest4559-21seq21:15:191
1259199201,11cyclictest28641-21/usr/sbin/munin23:25:121
1259199201,10cyclictest32009-21mailstats23:30:251
1259199200,2cyclictest0-21swapper/121:06:461
1259199200,13cyclictest87550irq/128-enp1s0-21:56:171
1258499202,17cyclictest7095-21kworker/0:220:10:390
1260199192,3cyclictest0-21swapper/322:23:483
1260199191,15cyclictest21693-21diskstats21:55:173
1259199199,2cyclictest141382cpu20:25:131
1259199196,4cyclictest13544-21grep21:35:191
1259199192,3cyclictest0-21swapper/121:41:581
1259199192,3cyclictest0-21swapper/119:41:541
1259199192,16cyclictest0-21swapper/119:57:591
1259199192,16cyclictest0-21swapper/119:39:501
12591991916,2cyclictest0-21swapper/120:44:541
12591991914,3cyclictest12950-21awk22:50:021
1259199191,2cyclictest0-21swapper/119:17:491
1259199191,14cyclictest0-21swapper/100:30:351
1259199191,10cyclictest29356-21cut19:45:141
1259199191,10cyclictest25734-21cut20:50:161
1259199191,10cyclictest20461-21/usr/sbin/munin20:40:021
1259199182,7cyclictest12788-21/usr/sbin/munin19:10:251
1259199181,16cyclictest0-21swapper/120:01:221
1259199181,16cyclictest0-21swapper/119:50:491
1259199181,16cyclictest0-21swapper/119:20:341
1259199180,17cyclictest0-21swapper/123:05:241
1259199180,16cyclictest0-21swapper/120:05:321
1259199180,16cyclictest0-21swapper/120:05:321
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional