You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-13 - 08:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Sat Dec 13, 2025 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13276211599,11sleep30-21swapper/319:09:253
12971211594,16sleep20-21swapper/219:05:282
13109211292,15sleep10-21swapper/119:07:151
13298210579,6sleep00-21swapper/019:09:420
107142720,0sleep30-21swapper/323:01:323
304572690,0sleep30-21swapper/300:29:423
197192690,0sleep00-21swapper/019:25:120
164822680,0sleep20-21swapper/222:01:012
236212670,6sleep31335299cyclictest20:55:113
1335099380,36cyclictest0-21swapper/123:25:111
1335099340,32cyclictest0-21swapper/123:15:081
13351993314,17cyclictest0-21swapper/220:30:112
13349993112,18cyclictest0-21swapper/021:00:120
1334999280,2cyclictest0-21swapper/020:35:110
1334999270,25cyclictest0-21swapper/022:45:080
1334999232,6cyclictest0-21swapper/022:15:200
149532210,1sleep214955-21grep19:10:232
13352992117,2cyclictest0-21swapper/323:25:113
1335199210,2cyclictest0-21swapper/223:35:112
299132200,1sleep10-21swapper/119:50:121
13350992017,2cyclictest0-21swapper/123:50:081
1334999200,2cyclictest0-21swapper/023:58:530
1334999200,2cyclictest0-21swapper/021:30:320
1334999198,9cyclictest30673-21ssh21:43:250
1334999198,2cyclictest0-21swapper/023:11:260
1334999190,9cyclictest0-21swapper/022:42:090
1334999190,3cyclictest15281-21latency22:00:140
1334999190,2cyclictest0-21swapper/021:28:030
1334999190,2cyclictest0-21swapper/000:27:020
1334999190,18cyclictest0-21swapper/023:29:440
1334999190,18cyclictest0-21swapper/021:20:100
1334999190,11cyclictest19852-21ssh22:38:210
1334999190,11cyclictest0-21swapper/019:35:250
230002180,1sleep10-21swapper/100:20:351
1335199180,2cyclictest0-21swapper/220:35:112
1334999188,2cyclictest0-21swapper/000:14:520
1334999185,3cyclictest22636-21fschecks_count21:35:150
1334999180,9cyclictest6813-21ssh23:30:380
1334999180,2cyclictest6951-21ssh21:51:370
1334999180,2cyclictest0-21swapper/023:05:080
1334999180,2cyclictest0-21swapper/023:00:440
1334999180,2cyclictest0-21swapper/021:59:050
1334999180,2cyclictest0-21swapper/021:12:230
1334999180,2cyclictest0-21swapper/021:12:230
1334999180,2cyclictest0-21swapper/019:15:050
1334999180,1cyclictest0-21swapper/022:55:110
1334999180,16cyclictest575-21ssh22:51:120
1334999180,16cyclictest0-21swapper/022:10:110
1334999180,11cyclictest0-21swapper/022:23:060
13352991713,2cyclictest0-21swapper/321:40:113
1334999176,2cyclictest0-21swapper/000:30:250
1334999175,3cyclictest25804-21basename19:40:120
1334999174,3cyclictest7083-21cpuspeed_turbos00:05:100
1334999174,3cyclictest30152-21sh23:21:350
1334999171,3cyclictest14583-21cron23:40:000
1334999170,2cyclictest0-21swapper/022:26:560
1334999170,2cyclictest0-21swapper/021:45:540
1334999170,16cyclictest0-21swapper/021:18:510
1335299161,13cyclictest13675-21aten2.4-expect20:30:123
1335099161,13cyclictest0-21swapper/123:04:251
13350991611,3cyclictest0-21swapper/122:21:041
1335099160,12cyclictest0-21swapper/100:16:451
1334999168,2cyclictest0-21swapper/022:30:430
1334999167,2cyclictest0-21swapper/023:47:280
1334999164,3cyclictest765-21taskset19:57:000
1334999164,3cyclictest21374-21latency_hist20:50:000
1334999164,3cyclictest14936-21grep19:10:230
1334999163,3cyclictest6288-21sh00:04:530
1334999163,3cyclictest4827-21sh00:37:320
1334999163,3cyclictest3389-21cut20:05:110
1334999163,3cyclictest25216-21chrt20:57:570
1334999163,3cyclictest20261-21missed_timers22:05:150
1334999163,3cyclictest17647-21ssh00:15:190
1334999163,3cyclictest13270-21http20:30:000
1334999161,5cyclictest0-21swapper/020:35:000
13349991611,4cyclictest0-21swapper/023:50:320
1334999160,15cyclictest0-21swapper/000:20:190
13352991510,3cyclictest22068-21grep20:50:133
1335299150,3cyclictest31735-21cron21:45:013
1335299150,12cyclictest0-21swapper/323:35:093
13351991511,2cyclictest0-21swapper/223:11:372
13351991510,3cyclictest10583-21smartctl20:20:222
1335199150,13cyclictest0-21swapper/200:25:122
13350991511,2cyclictest0-21swapper/123:20:121
1335099150,13cyclictest0-21swapper/123:45:351
1334999157,2cyclictest0-21swapper/020:20:180
1334999155,2cyclictest27669-21apt-get19:45:110
1334999153,3cyclictest31439-21chrt19:54:520
1334999153,3cyclictest21791-21cpu20:50:110
1334999151,4cyclictest0-21swapper/023:40:000
13349991510,3cyclictest0-21swapper/019:30:130
1334999150,2cyclictest0-21swapper/020:10:200
1334999150,14cyclictest0-21swapper/023:19:020
124752150,3sleep10-21swapper/121:57:241
1335299149,3cyclictest21630-21ssh22:06:273
1335299149,3cyclictest0-21swapper/321:00:143
1335299143,6cyclictest0-21swapper/319:25:003
1335299142,7cyclictest0-21swapper/320:45:003
1335299141,3cyclictest4420-21ssh21:16:223
1335299141,2cyclictest29608-21fschecks_count22:15:113
13352991411,2cyclictest0-21swapper/322:40:133
1335299140,3cyclictest7600-21ssh23:31:403
1335199149,3cyclictest0-21swapper/200:30:092
1335199142,6cyclictest0-21swapper/220:49:012
1335199140,12cyclictest26219-21kworker/2:119:50:152
1335199140,12cyclictest2468-21timerandwakeup20:00:252
1335199140,12cyclictest2151-21ssh22:53:372
1335199140,12cyclictest0-21swapper/223:01:472
1335199140,12cyclictest0-21swapper/222:16:472
1335199140,12cyclictest0-21swapper/221:39:062
1335199140,12cyclictest0-21swapper/221:34:352
1335099149,4cyclictest0-21swapper/122:11:321
1335099141,2cyclictest8929-21users21:20:241
13350991411,2cyclictest29412-21diskmemload23:36:551
13350991411,2cyclictest0-21swapper/100:31:091
1335099140,3cyclictest0-21swapper/122:05:121
1335099140,2cyclictest0-21swapper/100:25:451
1335099140,12cyclictest0-21swapper/100:05:141
229762130,2sleep30-21swapper/300:20:343
1335299138,3cyclictest30725-21sh23:22:293
1335299138,3cyclictest24130-21ssh21:35:593
1335299138,3cyclictest0-21swapper/319:45:163
1335299132,6cyclictest0-21swapper/323:00:003
13352991310,2cyclictest10034-21ssh00:07:583
13352991310,2cyclictest0-21swapper/323:59:113
13352991310,2cyclictest0-21swapper/322:46:093
1335299130,2cyclictest0-21swapper/323:10:273
1335299130,2cyclictest0-21swapper/322:34:213
1335299130,2cyclictest0-21swapper/300:01:503
1335299130,12cyclictest0-21swapper/321:53:593
1335299130,11cyclictest0-21swapper/300:36:083
1335199139,2cyclictest0-21swapper/223:55:212
1335199132,7cyclictest28884-21copy22:15:012
13351991310,2cyclictest0-21swapper/223:45:082
13351991310,2cyclictest0-21swapper/221:10:222
13351991310,2cyclictest0-21swapper/221:10:222
13351991310,2cyclictest0-21swapper/200:36:582
1335199130,2cyclictest26167-21ssh23:17:572
1335199130,2cyclictest0-21swapper/221:57:352
1335199130,2cyclictest0-21swapper/200:00:492
1335199130,12cyclictest0-21swapper/200:13:282
1335099139,2cyclictest0-21swapper/119:10:161
1335099131,10cyclictest0-21swapper/120:30:201
13350991310,2cyclictest0-21swapper/123:09:141
13350991310,2cyclictest0-21swapper/122:55:141
13350991310,2cyclictest0-21swapper/122:39:431
13350991310,2cyclictest0-21swapper/122:30:241
13350991310,2cyclictest0-21swapper/122:19:141
13350991310,2cyclictest0-21swapper/122:01:341
13350991310,2cyclictest0-21swapper/121:52:361
13350991310,2cyclictest0-21swapper/121:41:241
13350991310,2cyclictest0-21swapper/121:35:141
13350991310,2cyclictest0-21swapper/121:31:381
13350991310,2cyclictest0-21swapper/121:19:551
13350991310,2cyclictest0-21swapper/121:11:351
13350991310,2cyclictest0-21swapper/121:11:351
13350991310,2cyclictest0-21swapper/119:20:231
13350991310,2cyclictest0-21swapper/119:20:001
13350991310,2cyclictest0-21swapper/100:00:351
1335099130,3cyclictest24604-21cut20:55:201
1335099130,2cyclictest0-21swapper/122:45:091
1335099130,2cyclictest0-21swapper/100:35:301
1335099130,12cyclictest0-21swapper/123:55:351
1335099130,12cyclictest0-21swapper/123:31:351
1335099130,12cyclictest0-21swapper/122:51:031
1335099130,12cyclictest0-21swapper/122:41:311
1335099130,12cyclictest0-21swapper/122:26:061
1334999131,4cyclictest0-21swapper/020:00:290
18802120,2sleep20-21swapper/221:46:332
1335299129,2cyclictest0-21swapper/323:53:413
1335299129,2cyclictest0-21swapper/322:27:383
1335299129,2cyclictest0-21swapper/322:20:293
1335299129,2cyclictest0-21swapper/322:10:303
1335299129,2cyclictest0-21swapper/321:20:503
1335299129,2cyclictest0-21swapper/320:05:003
1335299129,2cyclictest0-21swapper/300:18:113
1335299127,3cyclictest0-21swapper/323:06:473
1335299122,7cyclictest0-21swapper/320:14:583
1335299120,2cyclictest0-21swapper/323:45:303
1335299120,2cyclictest0-21swapper/323:41:123
1335299120,2cyclictest0-21swapper/322:35:243
1335299120,2cyclictest0-21swapper/321:11:293
1335299120,2cyclictest0-21swapper/321:11:293
1335299120,2cyclictest0-21swapper/320:35:113
1335299120,2cyclictest0-21swapper/300:12:413
1335299120,11cyclictest0-21swapper/323:16:583
1335299120,11cyclictest0-21swapper/322:50:503
1335299120,11cyclictest0-21swapper/321:57:273
1335299120,11cyclictest0-21swapper/321:27:493
1335299120,11cyclictest0-21swapper/300:31:383
1335199129,2cyclictest16836-21ssh23:40:582
1335199129,2cyclictest0-21swapper/222:20:052
1335199129,2cyclictest0-21swapper/221:25:102
1335199129,2cyclictest0-21swapper/221:16:562
1335199129,2cyclictest0-21swapper/220:25:252
1335199129,2cyclictest0-21swapper/220:15:112
1335199129,2cyclictest0-21swapper/219:25:242
1335199129,2cyclictest0-21swapper/219:15:272
1335199129,2cyclictest0-21swapper/200:20:262
1335199122,7cyclictest0-21swapper/222:45:582
1335199120,2cyclictest19581-21cpu22:05:112
1335199120,2cyclictest0-21swapper/223:50:372
1335199120,2cyclictest0-21swapper/223:25:572
1335199120,2cyclictest0-21swapper/222:56:182
1335199120,2cyclictest0-21swapper/222:42:462
1335199120,2cyclictest0-21swapper/222:35:242
1335199120,2cyclictest0-21swapper/222:31:172
1335199120,2cyclictest0-21swapper/221:42:252
1335199120,11cyclictest0-21swapper/223:33:472
1335199120,11cyclictest0-21swapper/223:05:162
1335199120,11cyclictest0-21swapper/222:25:222
1335199120,11cyclictest0-21swapper/221:51:252
1335199120,11cyclictest0-21swapper/220:00:002
1335199120,11cyclictest0-21swapper/219:40:132
1335199120,11cyclictest0-21swapper/200:18:352
1335199120,11cyclictest0-21swapper/200:06:042
1335199120,10cyclictest0-21swapper/220:55:112
1335099129,2cyclictest0-21swapper/123:40:201
1335099129,2cyclictest0-21swapper/123:13:001
1335099129,2cyclictest0-21swapper/120:40:271
1335099129,2cyclictest0-21swapper/100:10:231
1335099122,7cyclictest0-21swapper/120:51:581
1335099122,7cyclictest0-21swapper/119:40:581
1335099121,3cyclictest27622-21munin-node1
1335099121,3cyclictest27622-21munin-node1
1335099120,2cyclictest0-21swapper/121:46:131
1335099120,2cyclictest0-21swapper/121:26:321
1335099120,11cyclictest0-21swapper/120:00:171
1335099120,11cyclictest0-21swapper/119:45:171
9972110,2sleep30-21swapper/320:00:013
1335299118,2cyclictest0-21swapper/322:00:293
1335299118,2cyclictest0-21swapper/321:33:203
1335299118,2cyclictest0-21swapper/319:50:203
1335299111,7cyclictest0-21swapper/319:26:583
1335299110,10cyclictest654-21kworker/u8:119:32:043
1335199118,2cyclictest27622-21munin-node2
1335199118,2cyclictest27622-21munin-node2
1335199118,2cyclictest0-21swapper/221:23:562
1335199118,2cyclictest0-21swapper/221:00:242
1335199112,6cyclictest0-21swapper/219:31:012
1335199111,8cyclictest6937-21taskset20:12:462
1335199110,10cyclictest0-21swapper/223:20:472
1335099111,8cyclictest4419-21cat20:05:231
1335099111,5cyclictest0-21swapper/120:15:001
1335099111,3cyclictest23636-21munin-node1
1335099110,9cyclictest9468-21munin-node1
1335099110,3cyclictest0-21swapper/119:30:151
1335299105,3cyclictest7458-21runrttasks19:11:003
1335299105,3cyclictest5884-21dbus-daemon19:15:043
1335299105,3cyclictest32687-21pzem_power19:55:193
1335299105,3cyclictest23948-21df_abs19:35:133
1335299101,7cyclictest20969-21grep20:45:233
1335299100,9cyclictest0-21swapper/319:40:123
1335199106,2cyclictest0-21swapper/219:45:212
1335199102,7cyclictest0-21swapper/220:40:582
1335199102,6cyclictest0-21swapper/219:35:232
1335199101,6cyclictest7427-21metacity20:09:582
1335199100,7cyclictest0-21swapper/220:52:582
1335199100,7cyclictest0-21swapper/219:20:582
1335099106,2cyclictest32547-21ntpdc19:55:161
1335099102,7cyclictest0-21swapper/120:29:581
1335099101,7cyclictest25757-21basename21:00:131
1335099101,5cyclictest0-21swapper/120:35:001
1335099101,2cyclictest19577-21munin-node1
1335099100,3cyclictest7419-21munin-node1
1334999106,3cyclictest8106-21interrupts20:15:140
1334999105,3cyclictest18193-21grep20:40:160
1334999101,7cyclictest19404-21cron19:25:000
1334999100,9cyclictest0-21swapper/021:08:120
1334999100,9cyclictest0-21swapper/021:08:120
133529994,3cyclictest8470-21pzem_voltage20:15:213
133529994,3cyclictest27988-21df_abs21:05:153
133529994,3cyclictest27988-21df_abs21:05:153
133529993,4cyclictest12816-21grep20:25:263
133529992,4cyclictest0-21swapper/320:20:013
133509990,7cyclictest19626-21munin-node1
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional