You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-20 - 01:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Sat Dec 20, 2025 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17185211793,19sleep30-21swapper/319:08:143
17099211193,12sleep20-21swapper/219:07:082
17212210580,20sleep00-21swapper/019:08:340
17253210488,11sleep10-21swapper/119:09:071
29712770,0sleep00-21swapper/022:25:000
17349994022,16cyclictest0-21swapper/123:15:151
17351993817,19cyclictest0-21swapper/321:00:123
178102260,1sleep0101ktimersoftd/021:28:130
1735199240,22cyclictest0-21swapper/300:05:123
205322230,1sleep10-21swapper/119:15:191
209512220,0sleep10-21swapper/100:34:011
1735199210,18cyclictest0-21swapper/319:50:113
1734999210,19cyclictest0-21swapper/100:25:121
302792190,2sleep011-21rcuc/000:07:390
1734899190,2cyclictest0-21swapper/023:10:120
17348991714,2cyclictest27349-21kworker/u8:221:40:040
1735199161,13cyclictest21340-21ssh22:08:533
1735199160,14cyclictest6418-21hwlatdetect21:15:173
17350991611,3cyclictest0-21swapper/221:32:252
1734999164,2cyclictest0-21swapper/123:33:121
1734999161,3cyclictest0-21swapper/123:25:041
17349991613,2cyclictest328750irq/24-eth123:05:121
189742151,3sleep019118-21perl23:55:120
174132150,3sleep00-21swapper/023:16:130
1735199151,12cyclictest29361-21munin-run21:00:003
17351991510,3cyclictest12944-21munin-node3
1735199150,2cyclictest0-21swapper/321:25:163
1735099151,2cyclictest29355-21apt-get21:00:042
17350991512,2cyclictest962-21diskmemload22:08:352
1735099151,12cyclictest962-21diskmemload22:26:082
1735099151,12cyclictest962-21diskmemload21:36:532
17350991511,2cyclictest110522sleep222:33:362
17350991510,3cyclictest0-21swapper/221:18:272
1735099150,2cyclictest962-21diskmemload22:02:042
1735099150,2cyclictest0-21swapper/221:29:242
1735099150,13cyclictest0-21swapper/222:56:022
1734999151,3cyclictest4081-21munin-run21:50:001
1734999151,3cyclictest11685-21iostat_ios23:10:161
1734999150,2cyclictest0-21swapper/122:45:041
1734999150,13cyclictest328750irq/24-eth121:34:101
17348991512,2cyclictest22971-21rm00:00:040
17348991512,2cyclictest15574-21kworker/u8:100:13:040
17348991511,2cyclictest0-21swapper/021:10:000
1734899150,13cyclictest0-21swapper/023:41:020
1734899150,13cyclictest0-21swapper/023:41:020
105062150,2sleep00-21swapper/000:21:140
299692141,3sleep129978-21ssh21:41:131
257662140,2sleep00-21swapper/000:39:420
234342140,1sleep20-21swapper/222:46:482
212462140,2sleep00-21swapper/021:31:230
1735199149,3cyclictest25047-21ssh00:01:113
17351991411,2cyclictest0-21swapper/322:18:273
17351991411,2cyclictest0-21swapper/322:04:213
17351991411,2cyclictest0-21swapper/321:38:023
17351991410,2cyclictest962-21diskmemload21:52:553
17351991410,2cyclictest0-21swapper/321:45:183
1735199140,3cyclictest4599-21ssh23:02:303
1735199140,3cyclictest0-21swapper/322:55:283
1735199140,2cyclictest0-21swapper/322:47:363
1735199140,2cyclictest0-21swapper/322:40:273
1735199140,2cyclictest0-21swapper/322:25:173
1735199140,13cyclictest15135-21ssh22:37:573
1735199140,13cyclictest0-21swapper/320:00:163
1735199140,12cyclictest3292-21taskset23:37:133
1735199140,12cyclictest3060-21ssh21:10:483
1735199140,12cyclictest0-21swapper/323:56:503
1735199140,12cyclictest0-21swapper/323:46:223
1735199140,12cyclictest0-21swapper/323:19:023
1735199140,12cyclictest0-21swapper/322:32:403
1735199140,12cyclictest0-21swapper/322:14:163
1735199140,12cyclictest0-21swapper/322:14:153
1735199140,12cyclictest0-21swapper/300:39:513
1735099149,3cyclictest29139-21tr21:40:232
17350991411,2cyclictest962-21diskmemload00:22:242
17350991411,2cyclictest0-21swapper/223:11:042
1735099140,3cyclictest6675-21snmpd23:36:502
1735099140,2cyclictest9626-21smartctl21:55:152
1735099140,2cyclictest0-21swapper/222:16:152
1735099140,2cyclictest0-21swapper/220:45:152
1735099140,13cyclictest0-21swapper/223:50:252
1735099140,12cyclictest962-21diskmemload23:58:402
1735099140,12cyclictest962-21diskmemload23:49:382
1735099140,12cyclictest962-21diskmemload23:42:512
1735099140,12cyclictest962-21diskmemload23:42:502
1735099140,12cyclictest962-21diskmemload23:30:182
1735099140,12cyclictest962-21diskmemload23:26:502
1735099140,12cyclictest962-21diskmemload23:08:212
1735099140,12cyclictest962-21diskmemload22:52:372
1735099140,12cyclictest962-21diskmemload22:20:432
1735099140,12cyclictest962-21diskmemload00:33:012
1735099140,12cyclictest0-21swapper/223:17:132
1735099140,12cyclictest0-21swapper/200:29:472
1735099140,12cyclictest0-21swapper/200:05:202
1734999149,3cyclictest0-21swapper/100:05:161
1734999142,7cyclictest0-21swapper/121:50:001
17349991411,2cyclictest962-21diskmemload23:52:501
17349991411,2cyclictest32335-21kworker/u8:021:58:051
17349991411,2cyclictest0-21swapper/121:13:201
1734999140,12cyclictest962-21diskmemload22:22:301
1734999140,12cyclictest0-21swapper/123:36:451
1734899148,4cyclictest0-21swapper/021:50:110
1734899142,7cyclictest0-21swapper/019:50:010
1734899142,7cyclictest0-21swapper/000:30:010
1734899142,6cyclictest0-21swapper/020:20:000
1734899141,11cyclictest20764-21apt-get22:45:040
1734899140,12cyclictest0-21swapper/022:15:150
1734899140,12cyclictest0-21swapper/020:20:140
61682130,3sleep00-21swapper/021:15:150
1735199139,2cyclictest962-21diskmemload21:55:453
1735199139,2cyclictest0-21swapper/319:25:133
1735199138,3cyclictest19625-21cut21:30:153
1735199132,6cyclictest0-21swapper/323:15:003
17351991310,2cyclictest0-21swapper/323:29:423
17351991310,2cyclictest0-21swapper/323:07:233
17351991310,2cyclictest0-21swapper/322:50:073
17351991310,2cyclictest0-21swapper/321:42:173
17351991310,2cyclictest0-21swapper/320:45:113
17351991310,2cyclictest0-21swapper/320:35:263
17351991310,2cyclictest0-21swapper/319:55:123
17351991310,2cyclictest0-21swapper/319:45:193
17351991310,2cyclictest0-21swapper/300:34:293
17351991310,2cyclictest0-21swapper/300:24:133
1735199130,2cyclictest0-21swapper/323:51:533
1735199130,2cyclictest0-21swapper/323:32:043
1735199130,12cyclictest0-21swapper/323:21:333
1735199130,12cyclictest0-21swapper/322:22:323
1735199130,12cyclictest0-21swapper/321:20:153
1735199130,12cyclictest0-21swapper/320:25:173
1735199130,11cyclictest0-21swapper/320:05:133
17350991310,2cyclictest962-21diskmemload21:20:442
17350991310,2cyclictest962-21diskmemload00:40:012
17350991310,2cyclictest962-21diskmemload00:19:072
17350991310,2cyclictest0-21swapper/223:23:242
17350991310,2cyclictest0-21swapper/223:00:152
17350991310,2cyclictest0-21swapper/221:05:202
17350991310,2cyclictest0-21swapper/220:30:142
17350991310,2cyclictest0-21swapper/220:00:142
1735099130,2cyclictest962-21diskmemload00:01:452
1735099130,12cyclictest0-21swapper/222:40:452
1735099130,12cyclictest0-21swapper/222:35:452
1735099130,11cyclictest0-21swapper/222:11:042
1735099130,11cyclictest0-21swapper/222:11:032
1735099130,11cyclictest0-21swapper/200:10:322
1734999138,4cyclictest0-21swapper/123:46:491
1734999131,10cyclictest0-21swapper/100:10:171
17349991310,2cyclictest962-21diskmemload00:04:071
17349991310,2cyclictest0-21swapper/122:14:001
17349991310,2cyclictest0-21swapper/122:13:591
17349991310,2cyclictest0-21swapper/121:36:021
1734999130,2cyclictest962-21diskmemload21:26:141
1734999130,2cyclictest0-21swapper/123:01:491
1734999130,2cyclictest0-21swapper/122:40:151
1734999130,2cyclictest0-21swapper/122:09:051
1734999130,2cyclictest0-21swapper/100:24:151
1734999130,12cyclictest0-21swapper/123:20:561
1734999130,12cyclictest0-21swapper/120:35:201
1734999130,12cyclictest0-21swapper/100:35:351
1734999130,11cyclictest7161-21switchtime21:15:251
1734999130,11cyclictest0-21swapper/100:15:161
1734899138,3cyclictest0-21swapper/020:00:130
1734899133,6cyclictest26767-21ssh22:50:230
1734899132,7cyclictest0-21swapper/021:11:230
1734899132,6cyclictest0-21swapper/020:30:000
1734899132,6cyclictest0-21swapper/019:55:000
1734899131,6cyclictest0-21swapper/022:40:000
17348991310,2cyclictest0-21swapper/023:46:310
17348991310,2cyclictest0-21swapper/023:30:360
17348991310,2cyclictest0-21swapper/023:24:580
17348991310,2cyclictest0-21swapper/022:30:590
17348991310,2cyclictest0-21swapper/021:45:140
17348991310,2cyclictest0-21swapper/000:15:020
1734899130,2cyclictest0-21swapper/023:09:070
1734899130,2cyclictest0-21swapper/022:57:420
1734899130,11cyclictest962-21diskmemload22:24:570
1734899130,11cyclictest12074-21ssh21:58:110
1734899130,11cyclictest0-21swapper/022:37:400
1734899130,11cyclictest0-21swapper/022:13:300
1734899130,11cyclictest0-21swapper/022:13:290
1735199129,2cyclictest0-21swapper/300:15:033
1735199121,6cyclictest0-21swapper/319:40:013
1735199121,5cyclictest0-21swapper/319:20:003
1735199120,11cyclictest0-21swapper/323:42:343
1735199120,11cyclictest0-21swapper/323:42:333
1735199120,11cyclictest0-21swapper/319:40:173
1735199120,11cyclictest0-21swapper/300:11:043
1735099129,2cyclictest0-21swapper/221:51:332
1735099129,2cyclictest0-21swapper/221:10:012
1735099127,3cyclictest637-21ethtool21:45:172
1735099120,11cyclictest0-21swapper/220:55:252
1735099120,11cyclictest0-21swapper/220:50:232
1735099120,11cyclictest0-21swapper/219:40:172
1735099120,11cyclictest0-21swapper/219:20:112
1734999129,2cyclictest962-21diskmemload22:52:211
1734999129,2cyclictest0-21swapper/123:56:081
1734999129,2cyclictest0-21swapper/123:41:401
1734999129,2cyclictest0-21swapper/123:41:391
1734999129,2cyclictest0-21swapper/122:36:331
1734999129,2cyclictest0-21swapper/121:05:231
1734999129,2cyclictest0-21swapper/120:25:151
1734999129,2cyclictest0-21swapper/120:10:261
1734999127,3cyclictest23545-21munin-node1
1734999121,9cyclictest0-21swapper/120:40:121
1734999121,3cyclictest962-21diskmemload22:00:141
1734999121,3cyclictest5247-21munin-node1
1734999121,3cyclictest30543-21http_loadtime22:55:171
1734999121,3cyclictest0-21swapper/120:25:011
1734999120,2cyclictest0-21swapper/119:40:261
1734999120,2cyclictest0-21swapper/119:20:101
1734999120,11cyclictest0-21swapper/122:30:201
1734999120,11cyclictest0-21swapper/122:29:261
1734999120,11cyclictest0-21swapper/122:15:541
1734999120,11cyclictest0-21swapper/120:50:091
1734999120,11cyclictest0-21swapper/119:55:141
1734899129,2cyclictest0-21swapper/023:37:250
1734899129,2cyclictest0-21swapper/021:20:590
1734899122,6cyclictest0-21swapper/019:30:230
1734899122,6cyclictest0-21swapper/019:30:220
1734899121,6cyclictest0-21swapper/019:40:000
1734899121,2cyclictest19527-21ssh22:05:410
1734899120,2cyclictest0-21swapper/023:25:200
1734899120,2cyclictest0-21swapper/021:36:150
1734899120,2cyclictest0-21swapper/020:50:170
1734899120,2cyclictest0-21swapper/019:10:110
1734899120,11cyclictest0-21swapper/023:50:180
1734899120,11cyclictest0-21swapper/023:00:190
1734899120,11cyclictest0-21swapper/022:04:510
1734899120,11cyclictest0-21swapper/020:45:160
1734899120,10cyclictest962-21diskmemload00:31:000
1735199118,2cyclictest0-21swapper/319:10:133
1735199112,5cyclictest0-21swapper/320:20:013
1735199110,10cyclictest0-21swapper/321:05:103
1735099118,2cyclictest0-21swapper/220:35:122
1735099117,2cyclictest15488-21munin-node2
1735099111,6cyclictest0-21swapper/220:20:252
1735099111,5cyclictest0-21swapper/220:10:012
1735099111,5cyclictest0-21swapper/219:50:002
1735099111,3cyclictest0-21swapper/220:45:002
1735099110,10cyclictest0-21swapper/219:15:272
1734999116,3cyclictest10971-21ethtool21:20:151
1734999116,3cyclictest0-21swapper/119:50:131
1734999112,6cyclictest0-21swapper/120:07:021
1734999111,8cyclictest0-21swapper/119:25:161
1734999111,3cyclictest11456-21munin-node1
1734999111,3cyclictest0-21swapper/119:35:151
1734999110,9cyclictest29549-21grep21:00:001
1734999110,3cyclictest31659-21munin-node1
1734899116,3cyclictest20044-21fschecks_count19:15:160
1735199102,6cyclictest0-21swapper/320:30:243
1735099107,2cyclictest0-21swapper/220:15:112
1735099102,6cyclictest0-21swapper/219:36:022
1735099102,5cyclictest0-21swapper/219:51:062
1735099101,5cyclictest0-21swapper/219:10:012
1735099100,9cyclictest0-21swapper/219:34:552
1735099100,9cyclictest0-21swapper/219:34:552
1734999101,7cyclictest0-21swapper/120:30:271
1734999101,3cyclictest29620-21munin-node1
1734999101,3cyclictest17557-21munin-node1
1734999100,9cyclictest27095-21kworker/u8:019:32:051
1734999100,9cyclictest27095-21kworker/u8:019:32:041
1734899107,2cyclictest0-21swapper/020:10:140
1734899107,2cyclictest0-21swapper/019:20:130
1734899105,3cyclictest7684-21grep20:05:150
1734899105,3cyclictest18455-21ps20:30:200
1734899102,6cyclictest0-21swapper/021:00:240
1734899102,6cyclictest0-21swapper/020:40:580
1734899101,7cyclictest6604-21cron21:00:000
1734899101,7cyclictest0-21swapper/019:40:220
173519994,3cyclictest9477-21head20:10:113
173519994,3cyclictest22117-21grep19:20:133
173519994,3cyclictest21952-21cut20:40:123
173519991,4cyclictest0-21swapper/319:30:013
173519991,4cyclictest0-21swapper/319:30:013
173519991,3cyclictest0-21swapper/320:51:193
173519990,8cyclictest0-21swapper/320:20:273
173509994,3cyclictest23893-21tr19:25:122
173509991,6cyclictest0-21swapper/219:56:072
173509990,8cyclictest0-21swapper/220:10:032
173489994,3cyclictest4738-21chrt19:56:340
173489994,3cyclictest19607-21aten2.4-expect20:35:130
173489981,5cyclictest0-21swapper/019:25:060
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional