You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-16 - 07:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Tue Dec 16, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2540921450,1sleep225406-21cron22:04:592
236082121101,12sleep20-21swapper/219:05:142
24694211696,14sleep30-21swapper/319:08:153
24727211295,12sleep10-21swapper/119:08:411
24569210678,6sleep00-21swapper/019:06:400
278722770,0sleep00-21swapper/021:30:190
56162750,1sleep20-21swapper/221:41:472
250682740,0sleep10-21swapper/120:30:131
283342730,1sleep30-21swapper/321:30:263
209212710,0sleep20-21swapper/223:11:252
313792700,0sleep00-21swapper/023:24:350
206762280,0sleep320678-21ssh21:59:323
2485899260,24cyclictest0-21swapper/322:10:143
2485899231,2cyclictest0-21swapper/320:45:133
24858992219,2cyclictest0-21swapper/321:40:133
2485899220,2cyclictest0-21swapper/322:40:123
2485699221,2cyclictest0-21swapper/123:35:121
2485899210,2cyclictest0-21swapper/323:17:163
2485899210,2cyclictest0-21swapper/321:23:373
2485899210,2cyclictest0-21swapper/300:10:053
2485899210,2cyclictest0-21swapper/300:05:363
2485899210,19cyclictest0-21swapper/323:10:313
2485899210,19cyclictest0-21swapper/300:30:153
24856992117,2cyclictest0-21swapper/121:40:131
2485899200,3cyclictest8960-21runrttasks22:21:333
2485899200,3cyclictest7458-21runrttasks23:42:453
2485899200,3cyclictest25752-21taskset21:28:373
2485899200,3cyclictest21988-21ssh22:36:053
2485899200,3cyclictest0-21swapper/319:45:213
2485899200,2cyclictest6675-21snmpd20:25:133
2485899200,2cyclictest0-21swapper/323:34:323
2485899200,2cyclictest0-21swapper/323:04:563
2485899200,2cyclictest0-21swapper/322:04:583
2485899200,2cyclictest0-21swapper/321:51:553
2485899200,2cyclictest0-21swapper/320:55:283
2485899200,2cyclictest0-21swapper/319:10:173
2485899200,2cyclictest0-21swapper/300:25:073
2485899200,2cyclictest0-21swapper/300:20:143
2485899200,18cyclictest0-21swapper/323:35:133
2485899200,18cyclictest0-21swapper/322:57:553
2485899200,18cyclictest0-21swapper/322:57:543
2485899200,18cyclictest0-21swapper/321:12:133
2485899200,12cyclictest0-21swapper/323:06:273
2485899200,12cyclictest0-21swapper/321:47:153
2485899200,12cyclictest0-21swapper/319:50:233
24858991910,7cyclictest0-21swapper/322:46:123
2485899190,3cyclictest6675-21snmpd22:25:373
2485899190,3cyclictest0-21swapper/320:38:373
2485899190,3cyclictest0-21swapper/300:00:173
2485899190,2cyclictest0-21swapper/323:56:183
2485899190,2cyclictest0-21swapper/323:50:553
2485899190,2cyclictest0-21swapper/323:45:363
2485899190,2cyclictest0-21swapper/323:21:013
2485899190,2cyclictest0-21swapper/322:32:173
2485899190,2cyclictest0-21swapper/321:35:053
2485899190,2cyclictest0-21swapper/300:36:313
2485899190,17cyclictest0-21swapper/323:25:323
2485899190,17cyclictest0-21swapper/321:18:583
2485899190,17cyclictest0-21swapper/319:40:253
2485899181,3cyclictest28868-21sendmail19:20:003
2485899180,2cyclictest8671-21diskmemload22:07:373
2485899180,2cyclictest6462chrt19:30:053
2485899180,2cyclictest0-21swapper/322:50:053
2485899180,2cyclictest0-21swapper/322:15:133
2485899180,2cyclictest0-21swapper/321:05:173
2485899180,2cyclictest0-21swapper/321:00:263
2485899180,2cyclictest0-21swapper/320:50:133
2485899180,2cyclictest0-21swapper/320:15:133
2485899180,17cyclictest11600-21ssh00:15:233
24856991814,2cyclictest0-21swapper/121:10:141
2485899170,2cyclictest308362sleep320:44:493
2485899170,2cyclictest0-21swapper/320:30:173
2485899170,2cyclictest0-21swapper/320:24:533
2485899170,2cyclictest0-21swapper/320:10:173
2485899170,2cyclictest0-21swapper/320:05:173
2485899170,2cyclictest0-21swapper/320:00:133
2485899170,2cyclictest0-21swapper/319:55:253
2485899170,2cyclictest0-21swapper/319:20:133
2485699171,14cyclictest21047-21runrttasks23:50:001
57422160,2sleep00-21swapper/022:19:050
2485899160,2cyclictest0-21swapper/319:35:173
2485899160,2cyclictest0-21swapper/319:25:133
2485799161,3cyclictest30857-21apt-get20:45:062
2485799161,13cyclictest29686-21ssh23:21:262
2485799160,14cyclictest8671-21diskmemload00:31:262
2485699161,3cyclictest9884-21sh23:00:031
2485699161,13cyclictest0-21swapper/100:40:001
250032151,3sleep025064-21aten2.4-expect20:30:130
24857991512,2cyclictest0-21swapper/223:26:162
24857991512,2cyclictest0-21swapper/221:53:462
2485799151,12cyclictest31713-21ssh00:01:032
2485799151,12cyclictest28475-21sh21:30:352
24857991511,2cyclictest0-21swapper/221:09:562
2485799150,3cyclictest17414-21ssh21:19:402
2485799150,13cyclictest28989-21ssh22:08:302
2485799150,13cyclictest28162-21fschecks_time00:35:142
2485799150,13cyclictest0-21swapper/222:10:512
2485799150,13cyclictest0-21swapper/221:56:502
24856991512,2cyclictest0-21swapper/122:15:131
2485699151,12cyclictest27712-21ssh23:56:381
2485699151,12cyclictest0-21swapper/122:24:541
2485699150,13cyclictest0-21swapper/119:25:141
213562150,4sleep021515-21cpuspeed_turbos22:00:140
167102150,3sleep00-21swapper/000:21:110
24857991411,2cyclictest8671-21diskmemload23:37:162
24857991411,2cyclictest0-21swapper/223:30:052
24857991411,2cyclictest0-21swapper/223:03:432
24857991411,2cyclictest0-21swapper/221:46:062
24857991410,2cyclictest9067-21sh00:12:542
2485799140,2cyclictest25764-21cat20:30:172
2485799140,2cyclictest17550-21ssh23:45:152
2485799140,2cyclictest0-21swapper/221:37:452
2485799140,13cyclictest0-21swapper/223:55:562
2485799140,13cyclictest0-21swapper/222:49:262
2485799140,13cyclictest0-21swapper/222:22:262
2485799140,12cyclictest0-21swapper/222:30:182
2485699142,7cyclictest0-21swapper/120:10:011
2485699141,2cyclictest21238-21apt-get23:50:121
24856991411,2cyclictest0-21swapper/123:17:231
2485699141,11cyclictest0-21swapper/120:25:251
24856991410,2cyclictest328750irq/24-eth121:15:161
2485699140,2cyclictest0-21swapper/123:43:231
2485699140,2cyclictest0-21swapper/122:00:031
2485699140,13cyclictest0-21swapper/100:32:531
2485699140,12cyclictest0-21swapper/100:02:511
24855991410,2cyclictest28475-21memory00:35:180
2485599140,2cyclictest0-21swapper/021:10:070
2485599140,12cyclictest0-21swapper/019:45:110
173122140,2sleep00-21swapper/022:30:400
24857991310,2cyclictest4202-21ssh00:07:142
24857991310,2cyclictest0-21swapper/223:41:252
24857991310,2cyclictest0-21swapper/222:36:162
24857991310,2cyclictest0-21swapper/222:27:532
24857991310,2cyclictest0-21swapper/222:15:362
24857991310,2cyclictest0-21swapper/221:25:302
24857991310,2cyclictest0-21swapper/221:20:222
24857991310,2cyclictest0-21swapper/219:35:122
24857991310,2cyclictest0-21swapper/200:21:532
2485799130,2cyclictest8671-21diskmemload22:40:052
2485799130,2cyclictest0-21swapper/223:05:572
2485799130,2cyclictest0-21swapper/221:10:412
2485799130,2cyclictest0-21swapper/200:25:562
2485799130,2cyclictest0-21swapper/200:16:142
2485799130,12cyclictest8671-21diskmemload23:19:182
2485799130,12cyclictest0-21swapper/223:50:372
2485799130,12cyclictest0-21swapper/222:55:222
2485799130,12cyclictest0-21swapper/222:55:222
2485799130,12cyclictest0-21swapper/219:50:102
2485699139,2cyclictest287302sleep123:20:231
2485699139,2cyclictest0-21swapper/123:30:181
2485699138,3cyclictest31446-21ssh21:35:121
2485699138,3cyclictest11560-21pzem00:15:211
2485699138,3cyclictest0-21swapper/119:35:171
2485699132,6cyclictest0-21swapper/122:05:001
2485699132,5cyclictest0-21swapper/119:25:001
2485699131,4cyclictest17722-21cut21:55:191
2485699131,3cyclictest0-21swapper/122:40:171
2485699131,10cyclictest7458-21runrttasks20:55:191
24856991310,2cyclictest0-21swapper/122:13:411
2485699130,2cyclictest8671-21diskmemload22:53:141
2485699130,11cyclictest8671-21diskmemload22:39:301
2485699130,11cyclictest0-21swapper/121:30:231
24855991310,2cyclictest8671-21diskmemload22:49:540
24855991310,2cyclictest0-21swapper/023:57:030
24855991310,2cyclictest0-21swapper/022:06:450
24855991310,2cyclictest0-21swapper/021:50:240
24855991310,2cyclictest0-21swapper/000:10:120
2485599130,3cyclictest29176-21aten2.4_r3power19:20:100
2485599130,2cyclictest0-21swapper/023:49:050
2485599130,2cyclictest0-21swapper/019:15:190
2485599130,12cyclictest0-21swapper/021:44:450
2485599130,12cyclictest0-21swapper/021:19:240
2485599130,12cyclictest0-21swapper/021:00:000
210902130,2sleep00-21swapper/023:11:450
2485799129,2cyclictest31247-21aten2.4_r3power19:25:142
2485799129,2cyclictest0-21swapper/222:52:492
2485799129,2cyclictest0-21swapper/220:40:172
2485799120,2cyclictest0-21swapper/220:20:192
2485799120,2cyclictest0-21swapper/219:30:132
2485799120,11cyclictest10366-21kworker/u8:219:57:042
2485799120,11cyclictest0-21swapper/219:10:272
2485699129,2cyclictest28967-21apt-get22:45:131
2485699129,2cyclictest0-21swapper/122:26:341
2485699129,2cyclictest0-21swapper/121:45:271
2485699129,2cyclictest0-21swapper/100:25:551
2485699129,2cyclictest0-21swapper/100:09:081
2485699127,4cyclictest0-21swapper/123:10:191
2485699127,3cyclictest16066-21runrttasks22:30:151
2485699123,7cyclictest6431-21nscd19:15:191
2485699122,8cyclictest18606-21cut21:20:181
2485699121,9cyclictest0-21swapper/123:05:151
2485699121,6cyclictest0-21swapper/100:15:001
2485699121,3cyclictest0-21swapper/123:25:011
2485699121,3cyclictest0-21swapper/120:45:191
2485699121,3cyclictest0-21swapper/120:20:171
2485699121,3cyclictest0-21swapper/119:45:131
2485699121,3cyclictest0-21swapper/119:30:141
2485699121,3cyclictest0-21swapper/119:10:181
2485699120,2cyclictest0-21swapper/119:50:211
2485699120,11cyclictest0-21swapper/122:59:091
2485699120,11cyclictest0-21swapper/122:59:091
2485699120,11cyclictest0-21swapper/121:51:111
2485699120,10cyclictest0-21swapper/120:50:191
2485599129,2cyclictest0-21swapper/022:23:580
2485599129,2cyclictest0-21swapper/022:11:220
2485599129,2cyclictest0-21swapper/021:39:250
2485599129,2cyclictest0-21swapper/021:26:110
2485599129,2cyclictest0-21swapper/021:23:350
2485599129,2cyclictest0-21swapper/000:27:560
2485599129,2cyclictest0-21swapper/000:00:340
2485599120,2cyclictest0-21swapper/023:40:240
2485599120,2cyclictest0-21swapper/023:35:170
2485599120,2cyclictest0-21swapper/023:28:240
2485599120,2cyclictest0-21swapper/022:51:530
2485599120,2cyclictest0-21swapper/019:25:270
2485599120,11cyclictest0-21swapper/023:31:430
2485599120,10cyclictest8671-21diskmemload23:17:180
2485699117,2cyclictest0-21swapper/119:55:131
2485699116,3cyclictest4693-21munin-node1
2485699116,3cyclictest0-21swapper/119:40:231
2485699112,7cyclictest0-21swapper/120:43:591
2485699112,6cyclictest6318-21Xorg21:05:591
2485699111,6cyclictest0-21swapper/120:05:091
2485699111,3cyclictest0-21swapper/100:22:341
2485699110,9cyclictest0-21swapper/121:25:131
2485699110,3cyclictest0-21swapper/120:15:151
2485599118,2cyclictest8671-21diskmemload00:10:000
2485599118,2cyclictest0-21swapper/023:05:480
2485599118,2cyclictest0-21swapper/022:41:120
2485599118,2cyclictest0-21swapper/020:40:140
2485599117,3cyclictest6533-21turbostat21:09:560
2485599111,8cyclictest18736-21munin-run20:15:000
2485599110,2cyclictest8671-21diskmemload21:47:500
2485599110,2cyclictest0-21swapper/023:54:110
2485599110,2cyclictest0-21swapper/021:57:420
2485599110,2cyclictest0-21swapper/000:34:120
2485599110,10cyclictest18987-21kworker/u8:120:46:040
2485599110,10cyclictest0-21swapper/022:55:270
2485599110,10cyclictest0-21swapper/022:55:270
2485599110,10cyclictest0-21swapper/022:38:220
132342110,2sleep00-21swapper/000:17:430
110672110,4sleep0101ktimersoftd/023:00:210
267532100,2sleep00-21swapper/019:13:450
2485799107,2cyclictest0-21swapper/219:15:172
2485799100,9cyclictest6264-21kworker/u8:120:04:042
2485799100,8cyclictest4257-21kworker/u8:020:59:042
2485699104,4cyclictest27026-21chrt20:35:051
2485699101,7cyclictest0-21swapper/120:00:141
2485599100,9cyclictest0-21swapper/022:28:370
2485599100,2cyclictest0-21swapper/021:00:260
2485599100,2cyclictest0-21swapper/019:55:240
248579994,3cyclictest27517-21tune2fs20:35:162
248579994,3cyclictest0-21swapper/220:25:162
248579993,4cyclictest16347-21sed20:05:302
248579990,8cyclictest23039-21kworker/u8:019:24:032
248559996,2cyclictest7458-21runrttasks19:44:520
248559994,3cyclictest23052-21tail20:25:130
248559990,8cyclictest0-21swapper/020:15:250
20461290,2sleep20-21swapper/220:16:332
248579984,3cyclictest4806-21aten2.4_r3power21:00:142
248579984,2cyclictest1071-21fschecks_count20:50:152
248579983,3cyclictest7201-21df_abs19:45:122
248579983,3cyclictest4993-21cpuspeed_turbos19:40:132
248579983,3cyclictest17011-21telnet20:10:132
248559985,2cyclictest0-21swapper/020:22:230
248559984,3cyclictest6431-21nscd20:35:160
248559983,3cyclictest1171-21fschecks_time20:50:150
248559980,7cyclictest15037-21kworker/u8:020:06:040
248559980,7cyclictest0-21swapper/020:00:150
248559980,2cyclictest0-21swapper/019:30:550
10416280,2sleep00-21swapper/019:51:390
248559970,2cyclictest0-21swapper/019:35:090
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional