You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-26 - 06:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Fri Dec 26, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9538211696,15sleep10-21swapper/119:07:401
9495211694,16sleep20-21swapper/219:07:092
9477211696,15sleep00-21swapper/019:06:550
9450211094,11sleep30-21swapper/319:06:343
22472800,1sleep10-21swapper/120:10:161
322742780,0sleep30-21swapper/323:10:013
26442770,0sleep00-21swapper/023:12:390
209352730,1sleep00-21swapper/022:19:120
257782700,0sleep20-21swapper/200:16:502
257782700,0sleep20-21swapper/200:16:492
160272690,0sleep10-21swapper/122:13:031
9745993717,18cyclictest0-21swapper/119:40:131
308792330,0sleep00-21swapper/023:45:180
12832290,6sleep2974699cyclictest22:33:572
22062250,1sleep10-21swapper/100:27:271
82842230,0sleep00-21swapper/020:25:140
82842230,0sleep00-21swapper/020:25:140
974799211,18cyclictest0-21swapper/322:00:153
974799210,3cyclictest28210-21aten2.4-expect23:05:133
974799210,3cyclictest27185-21ssh23:03:533
974799210,3cyclictest25893-21cut23:40:133
974799210,3cyclictest0-21swapper/322:55:173
974799210,3cyclictest0-21swapper/300:25:163
974799200,3cyclictest9457-21cut23:20:173
974799200,3cyclictest4374-21ssh22:36:453
974799200,3cyclictest30371-21ssh00:22:253
974799200,3cyclictest28926-21ssh22:27:573
974799200,3cyclictest18071-21ssh22:52:573
974799200,3cyclictest0-21swapper/322:49:173
974799200,3cyclictest0-21swapper/322:40:253
974799200,3cyclictest0-21swapper/321:23:253
974799200,3cyclictest0-21swapper/319:28:413
974799200,2cyclictest6267-21aten2.4_r3power23:55:133
974799200,2cyclictest0-21swapper/321:52:103
974799200,2cyclictest0-21swapper/321:17:083
974799200,18cyclictest0-21swapper/322:15:263
974799200,18cyclictest0-21swapper/322:12:503
47052200,1sleep20-21swapper/200:30:172
301182200,1sleep2301ktimersoftd/200:21:552
974799190,3cyclictest6675-21snmpd20:21:293
974799190,3cyclictest31227-21swap20:00:253
974799190,3cyclictest21587-21munin-node3
974799190,3cyclictest10791-21ssh00:37:133
974799190,3cyclictest0-21swapper/320:50:133
974799190,2cyclictest662-21grep21:55:173
974799190,2cyclictest1638-21ssh22:34:403
974799190,2cyclictest0-21swapper/323:50:213
974799190,2cyclictest0-21swapper/323:34:563
974799190,2cyclictest0-21swapper/323:25:293
974799190,2cyclictest0-21swapper/322:22:373
974799190,2cyclictest0-21swapper/321:42:283
974799190,2cyclictest0-21swapper/321:36:453
974799190,2cyclictest0-21swapper/321:33:093
974799190,2cyclictest0-21swapper/321:10:133
974799190,2cyclictest0-21swapper/319:10:173
974799190,2cyclictest0-21swapper/300:31:173
974799190,2cyclictest0-21swapper/300:11:333
974799190,2cyclictest0-21swapper/300:00:173
9746991916,2cyclictest25949-21kworker/u8:122:46:052
974799180,3cyclictest13713-21apt-get20:40:053
974799180,2cyclictest8771-21apt-get22:05:133
974799180,2cyclictest25829-21diskmemload00:05:133
974799180,2cyclictest25519-21ssh21:45:413
974799180,2cyclictest1664-21apt-get20:10:133
974799180,2cyclictest0-21swapper/323:45:173
974799180,2cyclictest0-21swapper/323:15:253
974799180,2cyclictest0-21swapper/321:29:173
974799180,2cyclictest0-21swapper/319:15:173
974799180,2cyclictest0-21swapper/300:15:213
974799180,2cyclictest0-21swapper/300:15:213
974799170,2cyclictest24842-21missed_timers21:05:173
9746991714,2cyclictest15102-21kworker/u8:122:17:052
974599171,14cyclictest9369-21wc23:20:151
974599171,14cyclictest8156-21users22:40:261
9744991713,3cyclictest7658-21kworker/u8:223:23:050
107732170,1sleep20-21swapper/223:21:232
974699161,13cyclictest0-21swapper/223:51:232
974699160,14cyclictest0-21swapper/223:37:392
974599160,14cyclictest25829-21diskmemload00:18:361
974599160,14cyclictest25829-21diskmemload00:18:361
974599160,13cyclictest0-21swapper/100:05:201
974799152,11cyclictest0-21swapper/319:50:223
974799151,4cyclictest29868-21cron20:00:003
974799151,4cyclictest18458-21cut19:30:143
974799151,3cyclictest22986-21processes21:00:203
974799151,12cyclictest20486-21cut20:55:173
9747991510,3cyclictest0-21swapper/320:05:163
974799150,2cyclictest0-21swapper/319:45:413
9746991512,2cyclictest21384-21kworker/u8:021:47:052
9746991512,2cyclictest0-21swapper/223:28:592
974699151,12cyclictest28872-21iostat_ios21:50:182
974699150,2cyclictest0-21swapper/200:00:392
974699150,13cyclictest0-21swapper/222:04:142
974699150,13cyclictest0-21swapper/219:20:152
974599151,3cyclictest14436-21fschecks_count19:20:141
974599151,3cyclictest0-21swapper/121:30:211
9745991512,2cyclictest0-21swapper/123:41:161
9745991512,2cyclictest0-21swapper/121:12:061
974599151,13cyclictest0-21swapper/121:35:561
974599151,12cyclictest26722-21munin-node1
974599151,12cyclictest10447-21ssh00:36:341
9745991510,3cyclictest5650-21sh00:30:561
974599150,13cyclictest31413-21taskset23:08:451
9744991512,2cyclictest29006-21kworker/u8:100:28:050
974499150,13cyclictest0-21swapper/022:56:360
114742150,0sleep00-21swapper/022:07:370
974799142,3cyclictest0-21swapper/319:40:143
974799141,3cyclictest8746-21sed20:25:183
974799141,3cyclictest8746-21sed20:25:183
974799141,3cyclictest7458-21runrttasks20:45:153
974799141,3cyclictest3999-21grep20:15:163
974799141,3cyclictest20509-21fschecks_time19:35:163
974799141,3cyclictest14025-21aten2.4-expect19:20:113
974799141,3cyclictest12194-21cut20:35:163
974799141,3cyclictest10326-21cut20:30:163
9746991411,2cyclictest25829-21diskmemload21:42:492
9746991411,2cyclictest25829-21diskmemload21:25:452
9746991411,2cyclictest25829-21diskmemload21:21:552
9746991411,2cyclictest0-21swapper/222:56:192
9746991411,2cyclictest0-21swapper/222:35:042
9746991411,2cyclictest0-21swapper/221:56:122
9746991411,2cyclictest0-21swapper/221:16:212
9746991411,2cyclictest0-21swapper/200:38:012
974699140,2cyclictest0-21swapper/222:44:532
974699140,2cyclictest0-21swapper/222:20:212
974699140,2cyclictest0-21swapper/221:35:292
974699140,2cyclictest0-21swapper/220:10:192
974699140,12cyclictest25829-21diskmemload23:40:352
974699140,12cyclictest25829-21diskmemload23:08:312
974699140,12cyclictest25829-21diskmemload22:08:242
974699140,12cyclictest0-21swapper/223:13:032
974599149,3cyclictest26667-21munin-node1
974599149,3cyclictest12984-21ssh23:25:131
9745991411,2cyclictest0-21swapper/122:01:261
9745991411,2cyclictest0-21swapper/100:21:541
974599140,3cyclictest1886-21latency_hist21:20:011
974599140,2cyclictest0-21swapper/122:49:361
974599140,13cyclictest0-21swapper/123:02:161
974599140,13cyclictest0-21swapper/100:12:561
974599140,12cyclictest12570-21runrttasks22:09:381
974599140,12cyclictest0-21swapper/121:55:091
974599140,12cyclictest0-21swapper/121:26:091
9744991411,2cyclictest30243-21kworker/u8:021:21:030
9744991411,2cyclictest28266-21kworker/u8:221:52:050
9744991411,2cyclictest25829-21diskmemload22:20:160
9744991411,2cyclictest13998-21apt-get19:20:110
974499141,11cyclictest0-21swapper/000:30:040
974499140,2cyclictest0-21swapper/020:00:150
974499140,12cyclictest25829-21diskmemload21:40:060
974499140,12cyclictest25150-21python21:05:240
974499140,12cyclictest0-21swapper/000:20:310
9746991310,2cyclictest15310-21sed00:05:182
9746991310,2cyclictest0-21swapper/223:30:312
9746991310,2cyclictest0-21swapper/223:16:502
9746991310,2cyclictest0-21swapper/221:10:342
9746991310,2cyclictest0-21swapper/219:55:132
9746991310,2cyclictest0-21swapper/219:25:162
974699130,2cyclictest0-21swapper/220:50:252
974699130,12cyclictest0-21swapper/223:55:282
974699130,12cyclictest0-21swapper/223:02:302
974699130,12cyclictest0-21swapper/221:32:332
974699130,12cyclictest0-21swapper/200:25:272
974699130,12cyclictest0-21swapper/200:10:022
974699130,11cyclictest25829-21diskmemload22:50:172
974599138,3cyclictest0-21swapper/123:50:231
974599138,3cyclictest0-21swapper/123:10:101
974599131,11cyclictest328750irq/24-eth122:51:301
974599131,10cyclictest0-21swapper/122:15:161
974599131,10cyclictest0-21swapper/121:20:151
9745991310,2cyclictest25829-21diskmemload23:56:321
9745991310,2cyclictest0-21swapper/123:35:271
9745991310,2cyclictest0-21swapper/121:40:251
9745991310,2cyclictest0-21swapper/119:55:001
9745991310,2cyclictest0-21swapper/100:00:161
974599130,3cyclictest0-21swapper/123:30:231
974599130,2cyclictest0-21swapper/123:17:061
974599130,2cyclictest0-21swapper/122:56:141
974599130,2cyclictest0-21swapper/122:34:351
974599130,2cyclictest0-21swapper/122:20:051
974599130,2cyclictest0-21swapper/120:50:211
974599130,12cyclictest0-21swapper/121:45:301
974599130,11cyclictest0-21swapper/120:20:201
9744991310,2cyclictest25829-21diskmemload22:39:390
9744991310,2cyclictest25829-21diskmemload21:10:530
9744991310,2cyclictest0-21swapper/023:30:270
9744991310,2cyclictest0-21swapper/023:25:110
9744991310,2cyclictest0-21swapper/022:52:280
9744991310,2cyclictest0-21swapper/022:46:560
9744991310,2cyclictest0-21swapper/022:30:570
9744991310,2cyclictest0-21swapper/022:12:080
9744991310,2cyclictest0-21swapper/021:32:590
9744991310,2cyclictest0-21swapper/021:00:130
974499130,2cyclictest25829-21diskmemload21:57:090
974499130,2cyclictest0-21swapper/023:18:070
974499130,2cyclictest0-21swapper/023:07:340
974499130,2cyclictest0-21swapper/021:25:530
974499130,2cyclictest0-21swapper/000:16:220
974499130,2cyclictest0-21swapper/000:16:220
974499130,12cyclictest0-21swapper/022:25:250
974499130,12cyclictest0-21swapper/021:46:560
974499130,12cyclictest0-21swapper/021:38:510
974499130,12cyclictest0-21swapper/019:55:130
974499130,12cyclictest0-21swapper/019:50:240
974499130,11cyclictest25829-21diskmemload23:55:370
974499130,11cyclictest0-21swapper/022:42:220
974499130,11cyclictest0-21swapper/019:45:130
974499130,11cyclictest0-21swapper/000:07:060
195092130,2sleep00-21swapper/019:31:180
113242130,2sleep00-21swapper/000:38:140
974699129,2cyclictest0-21swapper/222:28:412
974699129,2cyclictest0-21swapper/220:05:152
974699120,2cyclictest0-21swapper/223:45:112
974699120,11cyclictest0-21swapper/222:11:142
974599129,2cyclictest0-21swapper/123:47:431
974599129,2cyclictest0-21swapper/122:35:181
974599129,2cyclictest0-21swapper/120:05:241
974599129,2cyclictest0-21swapper/119:25:161
974599129,2cyclictest0-21swapper/119:15:121
974599122,5cyclictest0-21swapper/121:50:001
974599121,3cyclictest0-21swapper/119:10:171
974599120,2cyclictest0-21swapper/120:35:231
974599120,11cyclictest0-21swapper/121:05:151
974599120,11cyclictest0-21swapper/120:25:191
974599120,11cyclictest0-21swapper/120:25:191
974599120,11cyclictest0-21swapper/120:15:181
974599120,11cyclictest0-21swapper/119:30:151
974599120,10cyclictest0-21swapper/120:45:261
974499129,2cyclictest25829-21diskmemload23:35:430
974499129,2cyclictest0-21swapper/022:00:580
974499129,2cyclictest0-21swapper/000:00:210
9744991210,1cyclictest0-21swapper/020:15:190
974499120,2cyclictest0-21swapper/023:00:200
974499120,11cyclictest3693-21ssh23:51:050
974499120,11cyclictest0-21swapper/023:40:350
974499120,11cyclictest0-21swapper/021:16:200
974499120,11cyclictest0-21swapper/000:10:020
974699118,2cyclictest0-21swapper/220:30:192
974599117,2cyclictest20421-21diskstats19:35:151
974599116,3cyclictest30103-21munin-node1
974599111,8cyclictest0-21swapper/120:40:131
974599110,9cyclictest0-21swapper/120:55:151
974599110,9cyclictest0-21swapper/119:45:241
974599110,3cyclictest0-21swapper/121:00:181
974499110,10cyclictest20124-21kworker/u8:219:37:050
974699107,2cyclictest0-21swapper/219:45:152
974699100,9cyclictest0-21swapper/221:05:232
974599100,8cyclictest0-21swapper/120:30:131
974499104,2cyclictest0-21swapper/020:12:050
139412100,2sleep20-21swapper/220:40:032
97469996,2cyclictest0-21swapper/220:25:172
97469996,2cyclictest0-21swapper/220:25:172
97469996,2cyclictest0-21swapper/219:10:162
97469994,3cyclictest23826-21munin-run21:05:002
97469991,3cyclictest17571-21taskset20:47:272
97469990,2cyclictest0-21swapper/220:20:172
97449996,2cyclictest0-21swapper/020:47:050
27798290,2sleep20-21swapper/219:54:202
97469985,2cyclictest0-21swapper/220:01:202
97469984,3cyclictest6318-21Xorg19:35:022
97469984,2cyclictest12191-21cpuspeed_turbos20:35:162
97469983,3cyclictest20039-21stty20:55:142
97469981,3cyclictest18057-21aten2.4_r3power19:30:122
97469980,2cyclictest0-21swapper/220:15:332
97449985,2cyclictest0-21swapper/020:40:050
97449985,2cyclictest0-21swapper/019:25:160
97449984,3cyclictest1003-21tail20:05:250
97449984,2cyclictest7109-21timerwakeupswit20:20:250
97449983,3cyclictest7458-21runrttasks19:40:140
97449983,3cyclictest19160-21wc20:50:260
11953280,2sleep20-21swapper/219:15:022
10218280,1sleep0101ktimersoftd/020:30:150
97469973,3cyclictest6431-21nscd19:40:132
97449974,2cyclictest12131-21cpu19:15:140
97449974,2cyclictest0-21swapper/020:35:130
97449973,3cyclictest20730-21sed20:55:190
97449973,2cyclictest10085-21telnet19:10:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional