You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-07 - 05:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Wed Jan 07, 2026 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
37612117106,6sleep20-21swapper/219:07:012
36382116104,6sleep30-21swapper/319:05:263
37872115104,6sleep00-21swapper/019:07:200
3713211495,14sleep10-21swapper/119:06:241
1445421100,1sleep314453-21ssh22:15:023
4022993414,18cyclictest31788-21taskset23:10:113
285942300,0sleep00-21swapper/020:10:120
402299251,3cyclictest0-21swapper/300:30:263
228722250,1sleep00-21swapper/022:24:250
402299220,3cyclictest17634-21ssh22:54:323
402099221,19cyclictest0-21swapper/100:25:111
216042220,0sleep10-21swapper/122:58:331
402299210,3cyclictest2505-21needreboot21:25:163
402299210,3cyclictest19015-21munin-node3
402299210,3cyclictest1562-21unixbench_singl20:20:253
402299210,3cyclictest12314-21irqstats00:35:173
402299210,2cyclictest0-21swapper/323:23:253
402099211,2cyclictest0-21swapper/121:05:121
402299200,3cyclictest6599-21df19:15:133
402299200,3cyclictest31698-21ssh21:21:293
402299200,3cyclictest30066-21sensors21:55:253
402299200,3cyclictest29289-21latency20:10:173
402299200,3cyclictest19558-21taskset00:07:323
402299200,3cyclictest13453-21processes20:50:173
402299200,3cyclictest0-21swapper/321:53:123
402299200,3cyclictest0-21swapper/300:20:133
402299200,3cyclictest0-21swapper/300:00:133
402299200,2cyclictest0-21swapper/323:09:083
402299200,2cyclictest0-21swapper/320:55:173
402299200,18cyclictest0-21swapper/321:05:123
402299190,3cyclictest26224-21ssh22:27:253
402299190,3cyclictest24899-21runrttasks23:37:413
402299190,3cyclictest2107-21ssh23:48:453
402299190,3cyclictest1918-21ssh22:36:013
402299190,3cyclictest18868-21ssh23:30:243
402299190,3cyclictest17337-21ssh21:41:133
402299190,3cyclictest0-21swapper/322:47:213
402299190,2cyclictest6589-21df_abs20:35:133
402299190,2cyclictest0-21swapper/323:40:173
402299190,2cyclictest0-21swapper/322:10:173
402299190,2cyclictest0-21swapper/321:33:413
402299190,2cyclictest0-21swapper/300:11:013
402299190,18cyclictest0-21swapper/323:51:283
402299190,12cyclictest7509-21ssh23:18:473
402299190,11cyclictest0-21swapper/322:44:033
402199190,18cyclictest0-21swapper/223:10:112
402299180,3cyclictest7100-21ssh22:05:333
402299180,3cyclictest31820-21ssh22:34:213
402299180,3cyclictest29834-21ssh00:19:493
402299180,3cyclictest29834-21ssh00:19:483
402299180,2cyclictest127762sleep319:30:133
402299180,2cyclictest0-21swapper/321:18:013
402299180,2cyclictest0-21swapper/300:28:103
402299180,12cyclictest0-21swapper/322:03:403
4021991815,2cyclictest10950-21kworker/u8:223:59:042
402299170,2cyclictest0-21swapper/320:30:123
402299170,11cyclictest0-21swapper/323:58:413
4021991713,2cyclictest20421-21timerwakeupswit22:20:262
402199171,14cyclictest0-21swapper/223:35:262
4020991712,3cyclictest0-21swapper/122:31:331
402299165,3cyclictest19411-21mailstats22:55:253
402299164,3cyclictest21714-21timerandwakeup19:50:253
402299164,3cyclictest21303-21if_eth021:10:163
402299164,10cyclictest27917-21sed20:05:273
402299160,2cyclictest30363-21apt-get20:15:053
4021991612,2cyclictest32537-21kworker/u8:200:22:052
402199161,13cyclictest0-21swapper/219:40:152
402199160,2cyclictest0-21swapper/223:47:352
4020991611,3cyclictest8547-21sh23:20:121
4020991610,4cyclictest0-21swapper/123:48:341
402299154,9cyclictest0-21swapper/323:00:153
402299154,3cyclictest12318-21latency_hist20:50:003
402299154,3cyclictest10052-21chrt20:42:533
402299153,3cyclictest46262sleep319:10:133
402299153,3cyclictest22581-21aten2.4_r3power19:55:123
402299151,4cyclictest17876-21unixbench_singl19:40:253
402299151,3cyclictest0-21swapper/323:25:143
402299151,3cyclictest0-21swapper/321:45:053
402299151,3cyclictest0-21swapper/321:35:163
402299151,3cyclictest0-21swapper/320:00:113
402299151,3cyclictest0-21swapper/319:20:183
402199151,3cyclictest0-21swapper/222:32:052
402199151,12cyclictest23095-21ssh21:12:042
402199151,12cyclictest0-21swapper/222:00:162
402199150,13cyclictest23318-21missed_timers19:55:172
4020991512,2cyclictest0-21swapper/100:05:241
402099150,13cyclictest0-21swapper/123:15:131
402099150,13cyclictest0-21swapper/123:04:521
401999150,13cyclictest0-21swapper/000:30:170
402299143,2cyclictest21832chrt20:25:053
402299141,3cyclictest0-21swapper/321:00:123
402299141,3cyclictest0-21swapper/319:45:113
402299141,3cyclictest0-21swapper/319:35:103
402299141,3cyclictest0-21swapper/319:25:133
4021991411,2cyclictest0-21swapper/222:11:562
4021991411,2cyclictest0-21swapper/221:45:062
4021991411,2cyclictest0-21swapper/200:39:462
402199140,2cyclictest0-21swapper/223:23:432
402199140,13cyclictest0-21swapper/222:05:552
402199140,12cyclictest19687-21switchtime21:05:262
402199140,12cyclictest0-21swapper/221:52:162
402199140,12cyclictest0-21swapper/200:26:022
402099142,6cyclictest0-21swapper/100:30:001
4020991411,2cyclictest0-21swapper/122:47:241
4020991411,2cyclictest0-21swapper/121:45:031
402099140,2cyclictest0-21swapper/123:29:341
402099140,12cyclictest858-21iostat20:20:161
402099140,12cyclictest0-21swapper/122:37:471
402099140,12cyclictest0-21swapper/100:12:181
401999140,12cyclictest0-21swapper/023:50:220
401999140,12cyclictest0-21swapper/021:22:170
401999140,12cyclictest0-21swapper/019:50:170
402199139,3cyclictest12-21rcu_preempt21:25:112
4021991310,2cyclictest28474-21kworker/u8:123:51:052
4021991310,2cyclictest20321-21diskmemload00:17:332
4021991310,2cyclictest20321-21diskmemload00:17:322
4021991310,2cyclictest17988-21kworker/u8:121:01:052
4021991310,2cyclictest0-21swapper/223:43:552
4021991310,2cyclictest0-21swapper/223:27:252
4021991310,2cyclictest0-21swapper/223:15:362
4021991310,2cyclictest0-21swapper/222:53:362
4021991310,2cyclictest0-21swapper/222:39:262
4021991310,2cyclictest0-21swapper/222:25:262
4021991310,2cyclictest0-21swapper/220:40:152
4021991310,2cyclictest0-21swapper/200:30:162
402199130,2cyclictest0-21swapper/223:34:512
402199130,2cyclictest0-21swapper/223:05:002
402199130,2cyclictest0-21swapper/222:57:412
402199130,2cyclictest0-21swapper/221:33:362
402199130,2cyclictest0-21swapper/219:25:252
402199130,12cyclictest0-21swapper/221:36:132
402199130,12cyclictest0-21swapper/200:12:462
402199130,11cyclictest0-21swapper/220:35:112
402099139,2cyclictest0-21swapper/123:57:331
402099139,2cyclictest0-21swapper/121:39:171
402099139,2cyclictest0-21swapper/119:55:211
402099132,6cyclictest0-21swapper/119:35:001
402099132,6cyclictest0-21swapper/119:20:001
4020991310,2cyclictest4018-21cyclictest22:12:281
4020991310,2cyclictest20321-21diskmemload21:25:011
4020991310,2cyclictest20321-21diskmemload21:10:431
4020991310,2cyclictest0-21swapper/122:25:021
4020991310,2cyclictest0-21swapper/122:01:031
4020991310,2cyclictest0-21swapper/121:55:181
4020991310,2cyclictest0-21swapper/100:36:131
402099130,2cyclictest0-21swapper/123:36:571
402099130,12cyclictest0-21swapper/123:10:541
402099130,12cyclictest0-21swapper/122:23:041
402099130,12cyclictest0-21swapper/121:41:121
402099130,12cyclictest0-21swapper/121:34:211
402099130,11cyclictest0-21swapper/123:31:241
402099130,11cyclictest0-21swapper/119:15:211
4019991311,1cyclictest0-21swapper/000:37:470
4019991310,2cyclictest7594-21ssh21:30:240
4019991310,2cyclictest20321-21diskmemload23:45:570
4019991310,2cyclictest20321-21diskmemload23:12:160
4019991310,2cyclictest12481-21apt-get20:50:100
4019991310,2cyclictest0-21swapper/023:25:200
4019991310,2cyclictest0-21swapper/021:42:570
4019991310,2cyclictest0-21swapper/019:45:230
401999130,2cyclictest0-21swapper/022:19:270
401999130,2cyclictest0-21swapper/000:05:130
401999130,12cyclictest10725-21ssh23:21:370
401999130,12cyclictest0-21swapper/023:36:060
401999130,12cyclictest0-21swapper/022:56:170
401999130,12cyclictest0-21swapper/022:25:260
401999130,12cyclictest0-21swapper/022:01:090
401999130,11cyclictest0-21swapper/023:01:390
138742130,1sleep00-21swapper/021:38:090
402199129,2cyclictest0-21swapper/222:45:162
402199129,2cyclictest0-21swapper/221:56:162
402199129,2cyclictest0-21swapper/200:08:592
402199120,8cyclictest0-21swapper/220:50:042
402199120,11cyclictest20321-21diskmemload22:43:102
402199120,11cyclictest0-21swapper/222:17:362
402199120,11cyclictest0-21swapper/221:22:242
402199120,11cyclictest0-21swapper/221:16:382
402199120,11cyclictest0-21swapper/220:25:272
402199120,11cyclictest0-21swapper/220:05:282
402099129,2cyclictest0-21swapper/123:50:131
402099129,2cyclictest0-21swapper/121:15:131
402099129,2cyclictest0-21swapper/120:25:171
402099129,2cyclictest0-21swapper/119:45:231
402099127,4cyclictest0-21swapper/123:06:411
402099127,3cyclictest27180-21hddtemp_smartct23:40:151
402099127,3cyclictest0-21swapper/119:10:161
402099121,9cyclictest14778-21grep19:35:131
402099121,9cyclictest0-21swapper/100:00:151
402099121,3cyclictest0-21swapper/120:15:051
402099120,2cyclictest0-21swapper/122:43:201
402099120,2cyclictest0-21swapper/119:25:211
402099120,2cyclictest0-21swapper/100:20:221
402099120,11cyclictest0-21swapper/122:51:281
402099120,11cyclictest0-21swapper/121:50:201
402099120,11cyclictest0-21swapper/119:50:171
402099120,11cyclictest0-21swapper/100:15:091
402099120,11cyclictest0-21swapper/100:15:081
401999129,2cyclictest28333-21ps23:05:170
401999129,2cyclictest20321-21diskmemload21:11:030
401999129,2cyclictest12007-21latency_hist00:00:000
401999129,2cyclictest0-21swapper/022:37:540
401999129,2cyclictest0-21swapper/021:56:340
401999129,2cyclictest0-21swapper/021:50:570
401999129,2cyclictest0-21swapper/019:25:150
401999129,2cyclictest0-21swapper/019:20:150
401999129,2cyclictest0-21swapper/000:25:240
401999120,2cyclictest0-21swapper/019:40:270
401999120,2cyclictest0-21swapper/000:20:060
401999120,2cyclictest0-21swapper/000:15:370
401999120,2cyclictest0-21swapper/000:15:370
401999120,11cyclictest0-21swapper/023:41:370
401999120,11cyclictest0-21swapper/022:52:470
401999120,11cyclictest0-21swapper/022:45:360
401999120,11cyclictest0-21swapper/022:40:240
401999120,11cyclictest0-21swapper/021:46:270
401999120,11cyclictest0-21swapper/021:28:020
401999120,11cyclictest0-21swapper/021:05:150
401999120,11cyclictest0-21swapper/019:35:170
401999120,11cyclictest0-21swapper/000:11:460
172362120,2sleep20-21swapper/221:41:032
146292120,1sleep00-21swapper/000:01:420
70662110,1sleep00-21swapper/022:05:310
60442110,1sleep00-21swapper/019:15:010
402199118,2cyclictest1896-21kworker/u8:219:24:052
402199118,2cyclictest14608-21kworker/u8:019:47:052
402199118,2cyclictest0-21swapper/220:15:172
402199110,2cyclictest0-21swapper/223:06:092
402199110,10cyclictest0-21swapper/200:01:052
402099116,3cyclictest5979-21munin-node1
402099112,7cyclictest0-21swapper/120:55:591
402099111,8cyclictest0-21swapper/121:00:181
402099111,8cyclictest0-21swapper/120:45:181
402099111,3cyclictest12478-21munin-node1
402099111,3cyclictest0-21swapper/120:40:121
402099111,3cyclictest0-21swapper/119:40:111
402099110,3cyclictest0-21swapper/120:10:261
402099110,2cyclictest0-21swapper/122:15:191
402099110,10cyclictest0-21swapper/121:20:311
401999118,2cyclictest0-21swapper/022:32:540
401999118,2cyclictest0-21swapper/022:12:140
401999110,2cyclictest0-21swapper/023:32:360
401999110,2cyclictest0-21swapper/023:16:530
401999110,10cyclictest28328-21kworker/u8:019:10:050
401999110,10cyclictest24164-21kworker/u8:220:05:050
401999110,10cyclictest12547-21kworker/u8:221:00:050
245652110,2sleep10-21swapper/120:00:131
144992110,2sleep00-21swapper/020:55:130
135802110,8sleep20-21swapper/219:30:252
52452100,2sleep20-21swapper/219:10:222
402199107,2cyclictest24164-21kworker/u8:220:01:042
402199107,2cyclictest14608-21kworker/u8:019:52:052
402199107,2cyclictest14608-21kworker/u8:019:37:052
402199107,2cyclictest12547-21kworker/u8:220:55:052
402199106,3cyclictest29925-21grep20:10:262
402199105,3cyclictest8210-21cron19:20:002
402099100,3cyclictest0-21swapper/120:30:261
401999107,2cyclictest0-21swapper/021:16:460
40219996,2cyclictest0-21swapper/220:45:112
40219994,3cyclictest443-21cpuspeed_turbos20:20:132
40209996,2cyclictest0-21swapper/120:05:191
40209990,8cyclictest0-21swapper/120:35:111
40199996,2cyclictest0-21swapper/020:15:060
40199990,2cyclictest0-21swapper/020:35:210
40219983,3cyclictest4458-21grep20:30:132
40199985,2cyclictest13849-21grep19:30:260
40199985,2cyclictest0-21swapper/019:55:250
40199984,3cyclictest5117-21ntp_states20:30:180
40199984,3cyclictest3073-21awk20:25:200
40199980,7cyclictest24164-21kworker/u8:220:03:050
40199980,7cyclictest0-21swapper/020:49:190
1635280,6sleep00-21swapper/020:20:430
40199970,6cyclictest0-21swapper/020:40:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional