You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-31 - 09:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Wed Dec 31, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1663921510,0sleep00-21swapper/000:20:100
29655211895,18sleep00-21swapper/019:06:150
29775211693,17sleep30-21swapper/319:07:463
29642211594,16sleep20-21swapper/219:06:052
29875211396,12sleep10-21swapper/119:09:041
39992840,1sleep14003-21hwlatdetect21:35:161
109712780,0sleep20-21swapper/219:40:212
228202730,1sleep011-21rcuc/023:10:430
241992690,0sleep30-21swapper/323:50:233
130862690,0sleep10-21swapper/121:05:211
101182670,0sleep30-21swapper/321:41:403
29976993516,18cyclictest0-21swapper/121:55:131
2997899255,18cyclictest0-21swapper/321:55:133
154602250,1sleep013852-21diskmemload21:10:260
116032250,1sleep311602-21sensors_fan22:20:243
64222210,0sleep30-21swapper/321:38:113
49852200,2sleep229-21rcuc/222:50:252
39082190,1sleep02997599cyclictest21:35:150
29976991913,4cyclictest13852-21diskmemload22:45:131
2997699190,3cyclictest0-21swapper/121:43:041
2997899180,16cyclictest0-21swapper/319:55:143
2997799181,15cyclictest0-21swapper/221:40:132
2997699183,2cyclictest0-21swapper/119:57:041
2997699181,2cyclictest0-21swapper/119:11:041
2997699180,5cyclictest0-21swapper/119:37:051
2997699180,3cyclictest0-21swapper/121:26:051
29978991712,3cyclictest12301-21ssh21:45:143
29977991714,2cyclictest23278-21kworker/u8:023:54:052
2997699172,2cyclictest0-21swapper/122:41:051
2997699171,2cyclictest0-21swapper/119:54:051
2997699170,3cyclictest0-21swapper/123:47:041
2997799161,13cyclictest4272-21ntp_kernel_pll_21:35:182
2997799161,13cyclictest0-21swapper/200:32:362
2997699162,2cyclictest0-21swapper/123:00:051
2997699161,2cyclictest0-21swapper/120:08:051
2997899150,14cyclictest0-21swapper/323:37:233
2997899150,13cyclictest0-21swapper/321:25:433
2997799151,3cyclictest10086-21munin-run22:20:002
29977991512,2cyclictest0-21swapper/222:13:142
2997799150,3cyclictest14314-21ssh23:00:532
2997799150,13cyclictest13852-21diskmemload23:27:512
2997799150,13cyclictest0-21swapper/200:20:432
29976991512,2cyclictest0-21swapper/122:26:111
29976991510,3cyclictest0-21swapper/123:56:271
2997699150,3cyclictest0-21swapper/122:55:141
2997699150,2cyclictest0-21swapper/122:05:201
2997699150,13cyclictest0-21swapper/121:33:461
29975991512,2cyclictest2273-21kworker/u8:000:08:070
2997599151,12cyclictest32212-21apt-get20:35:120
2997599150,14cyclictest0-21swapper/021:50:010
2997599150,13cyclictest13852-21diskmemload23:05:210
213452151,3sleep021354-21ssh21:18:050
2997899142,7cyclictest0-21swapper/320:20:003
29978991411,2cyclictest13852-21diskmemload22:50:133
2997899140,2cyclictest0-21swapper/323:15:433
2997899140,2cyclictest0-21swapper/321:30:133
2997899140,12cyclictest13852-21diskmemload22:08:233
2997899140,12cyclictest0-21swapper/323:34:233
2997899140,12cyclictest0-21swapper/322:30:123
2997899140,12cyclictest0-21swapper/300:21:043
29977991411,2cyclictest13852-21diskmemload21:24:342
29977991411,2cyclictest0-21swapper/223:22:442
29977991411,2cyclictest0-21swapper/222:44:172
29977991411,2cyclictest0-21swapper/222:20:542
29977991411,2cyclictest0-21swapper/221:47:432
29977991411,2cyclictest0-21swapper/221:19:032
29977991411,2cyclictest0-21swapper/200:07:342
29977991410,3cyclictest0-21swapper/200:26:102
2997799140,2cyclictest25929-21fschecks_time22:00:162
2997799140,13cyclictest0-21swapper/223:46:542
2997799140,12cyclictest0-21swapper/223:43:342
2997699149,3cyclictest0-21swapper/100:10:471
2997699141,2cyclictest13852-21diskmemload23:13:261
29976991411,2cyclictest0-21swapper/123:43:511
29976991411,2cyclictest0-21swapper/123:33:301
2997699141,12cyclictest0-21swapper/100:36:411
29976991411,2cyclictest0-21swapper/100:05:361
29976991410,2cyclictest1524-21apt-get23:25:121
2997699140,2cyclictest0-21swapper/122:18:491
2997699140,12cyclictest2570-21cat20:40:171
2997699140,12cyclictest22031-21ssh21:19:201
2997699140,12cyclictest19854-21rm00:23:301
2997699140,12cyclictest0-21swapper/121:21:101
2997599140,12cyclictest28718-21sed23:55:280
2997599140,12cyclictest0-21swapper/021:40:120
2997599140,12cyclictest0-21swapper/000:10:120
13912140,2sleep00-21swapper/000:01:350
2997899132,6cyclictest0-21swapper/320:45:003
2997899131,7cyclictest0-21swapper/323:10:003
2997899131,3cyclictest0-21swapper/322:25:213
29978991310,2cyclictest0-21swapper/323:55:333
29978991310,2cyclictest0-21swapper/323:13:243
29978991310,2cyclictest0-21swapper/322:56:433
29978991310,2cyclictest0-21swapper/300:28:343
29978991310,2cyclictest0-21swapper/300:17:343
29978991310,2cyclictest0-21swapper/300:03:233
2997899130,2cyclictest20878-21ssh21:17:123
2997899130,2cyclictest0-21swapper/322:04:133
2997899130,11cyclictest0-21swapper/323:25:123
29977991310,2cyclictest28318-21ntpdc23:55:192
29977991310,2cyclictest13852-21diskmemload22:06:502
29977991310,2cyclictest0-21swapper/223:35:192
29977991310,2cyclictest0-21swapper/222:55:022
29977991310,2cyclictest0-21swapper/222:25:542
29977991310,2cyclictest0-21swapper/221:30:242
29977991310,2cyclictest0-21swapper/221:10:172
29977991310,2cyclictest0-21swapper/220:25:182
29977991310,2cyclictest0-21swapper/220:05:172
29977991310,2cyclictest0-21swapper/200:35:032
2997799130,2cyclictest13852-21diskmemload22:30:082
2997799130,2cyclictest13852-21diskmemload21:26:042
2997799130,2cyclictest0-21swapper/222:45:342
2997799130,2cyclictest0-21swapper/221:55:142
2997799130,2cyclictest0-21swapper/221:05:182
2997799130,12cyclictest25195-21ssh22:36:032
2997799130,12cyclictest13852-21diskmemload00:19:002
2997799130,12cyclictest13852-21diskmemload00:01:362
2997799130,12cyclictest0-21swapper/223:15:422
2997799130,12cyclictest0-21swapper/223:13:222
2997799130,12cyclictest0-21swapper/221:53:422
2997799130,12cyclictest0-21swapper/220:50:242
2997799130,12cyclictest0-21swapper/200:12:382
29976991311,1cyclictest0-21swapper/123:38:071
2997699131,10cyclictest15960-21sh00:19:241
29976991310,2cyclictest0-21swapper/123:50:141
29976991310,2cyclictest0-21swapper/122:03:291
29976991310,2cyclictest0-21swapper/121:50:021
29976991310,2cyclictest0-21swapper/100:32:461
29976991310,2cyclictest0-21swapper/100:27:261
2997699130,2cyclictest13852-21diskmemload21:45:481
2997699130,2cyclictest13852-21diskmemload00:01:191
2997699130,2cyclictest0-21swapper/122:35:011
2997699130,12cyclictest0-21swapper/122:50:011
2997699130,12cyclictest0-21swapper/122:30:441
2997699130,12cyclictest0-21swapper/122:21:011
2997699130,12cyclictest0-21swapper/122:11:291
2997699130,12cyclictest0-21swapper/121:10:361
2997699130,12cyclictest0-21swapper/120:55:151
29975991310,2cyclictest0-21swapper/023:18:310
29975991310,2cyclictest0-21swapper/021:56:200
29975991310,2cyclictest0-21swapper/020:45:280
2997599130,3cyclictest13852-21diskmemload21:30:210
2997599130,2cyclictest0-21swapper/022:46:110
2997599130,2cyclictest0-21swapper/022:20:000
2997599130,12cyclictest0-21swapper/000:32:520
56842120,2sleep213852-21diskmemload23:30:012
2997899129,2cyclictest0-21swapper/322:13:033
2997899129,2cyclictest0-21swapper/300:07:033
2997899122,7cyclictest0-21swapper/320:23:023
2997899122,6cyclictest0-21swapper/300:35:003
2997899120,2cyclictest0-21swapper/323:46:143
2997899120,11cyclictest0-21swapper/322:45:133
2997899120,11cyclictest0-21swapper/321:21:533
2997899120,10cyclictest13852-21diskmemload22:17:253
2997899120,10cyclictest0-21swapper/322:41:213
2997799129,2cyclictest0-21swapper/223:06:112
2997799129,2cyclictest0-21swapper/219:10:142
2997799120,2cyclictest0-21swapper/219:30:162
2997799120,11cyclictest0-21swapper/221:00:162
2997799120,11cyclictest0-21swapper/219:45:172
2997699129,2cyclictest0-21swapper/123:20:451
2997699129,2cyclictest0-21swapper/121:00:191
2997699128,2cyclictest0-21swapper/123:05:071
2997699121,9cyclictest2175-21df_abs19:20:151
2997699120,2cyclictest0-21swapper/120:15:211
2997699120,11cyclictest0-21swapper/123:19:211
2997699120,11cyclictest0-21swapper/120:46:401
2997699120,11cyclictest0-21swapper/120:00:131
2997699120,11cyclictest0-21swapper/119:25:161
2997699120,11cyclictest0-21swapper/119:15:161
2997599129,2cyclictest0-21swapper/023:40:320
2997599129,2cyclictest0-21swapper/022:09:310
2997599120,2cyclictest13852-21diskmemload22:13:220
2997599120,2cyclictest0-21swapper/022:40:260
2997599120,2cyclictest0-21swapper/022:38:410
2997599120,11cyclictest0-21swapper/023:48:200
2997599120,11cyclictest0-21swapper/022:51:310
2997599120,11cyclictest0-21swapper/000:18:020
2997599120,10cyclictest20949-21kworker/u8:200:26:050
2997599120,10cyclictest13852-21diskmemload23:50:470
2997599120,10cyclictest13852-21diskmemload21:46:080
2997599120,10cyclictest0-21swapper/023:35:400
267132120,2sleep00-21swapper/021:24:540
2997899118,2cyclictest0-21swapper/321:11:313
2997899118,2cyclictest0-21swapper/319:10:123
2997899116,3cyclictest18357-21grep20:00:143
2997899112,6cyclictest0-21swapper/319:25:013
2997899111,8cyclictest0-21swapper/323:22:403
2997899111,6cyclictest0-21swapper/319:50:253
2997899110,9cyclictest13852-21diskmemload22:36:373
2997899110,2cyclictest0-21swapper/319:45:273
2997899110,2cyclictest0-21swapper/300:31:523
2997899110,10cyclictest0-21swapper/321:51:423
2997699117,2cyclictest0-21swapper/120:50:141
2997699112,2cyclictest21-21rcuc/119:45:191
2997699111,8cyclictest22107-21munin-node1
2997599118,2cyclictest0-21swapper/023:30:110
2997599118,2cyclictest0-21swapper/023:25:510
2997599118,2cyclictest0-21swapper/023:00:010
2997599118,2cyclictest0-21swapper/022:56:500
2997599118,2cyclictest0-21swapper/022:25:310
2997599118,2cyclictest0-21swapper/022:21:500
2997599118,2cyclictest0-21swapper/022:01:070
2997599118,2cyclictest0-21swapper/020:05:150
2997599118,2cyclictest0-21swapper/020:00:220
2997599118,2cyclictest0-21swapper/019:25:180
2997599118,2cyclictest0-21swapper/000:35:310
2997599110,9cyclictest23906-21http20:15:000
2997599110,2cyclictest0-21swapper/022:33:020
2997599110,10cyclictest11587-21kworker/u8:019:45:040
43762100,2sleep20-21swapper/219:25:152
2997899105,3cyclictest7759-21sshd19:34:403
2997899105,3cyclictest5240-21sshd20:45:403
2997899102,7cyclictest0-21swapper/321:09:593
2997899102,7cyclictest0-21swapper/321:00:593
2997899102,6cyclictest0-21swapper/320:50:243
2997899102,6cyclictest0-21swapper/320:35:243
2997899102,6cyclictest0-21swapper/319:15:223
2997899100,9cyclictest0-21swapper/320:10:163
2997899100,2cyclictest0-21swapper/323:04:443
2997799107,2cyclictest5424-21kworker/u8:120:59:052
2997799102,6cyclictest3514-21kworker/2:020:40:272
2997699100,8cyclictest10042-21munin-node1
2997699100,8cyclictest0-21swapper/120:30:141
2997699100,8cyclictest0-21swapper/120:25:191
2997699100,8cyclictest0-21swapper/120:20:251
2997599107,2cyclictest0-21swapper/023:22:110
2997599107,2cyclictest0-21swapper/019:15:150
2997599100,9cyclictest5424-21kworker/u8:120:54:050
2997599100,9cyclictest0-21swapper/021:27:350
168872100,1sleep30-21swapper/323:41:573
299789996,2cyclictest0-21swapper/300:12:333
299789994,3cyclictest8093-21aten2.4_r3power19:35:123
299789994,3cyclictest31988-21cron20:35:003
299789994,3cyclictest10883-21needreboot19:40:203
299789993,4cyclictest28890-21cut20:25:163
299789993,4cyclictest21878-21taskset20:09:553
299779996,2cyclictest8653-21ethtool19:35:162
299779994,3cyclictest611-21tr20:35:182
299779994,3cyclictest31285-21mailstats20:30:262
299779994,3cyclictest24562-21fschecks_count20:15:152
299779994,3cyclictest238912sleep220:15:002
299779994,3cyclictest18380-21cpuspeed_turbos20:00:142
299779994,3cyclictest14534-21fschecks_count19:50:142
299779993,4cyclictest4070-21tr20:45:162
299769996,2cyclictest0-21swapper/120:35:251
299769990,2cyclictest0-21swapper/119:30:131
299759990,8cyclictest21569-21kworker/u8:120:17:050
1504290,2sleep20-21swapper/219:19:232
299789983,3cyclictest8517-21grep20:55:163
299789983,3cyclictest3914-21aten2.4_r3power19:25:123
299779984,3cyclictest26545-21grep20:20:132
299779983,3cyclictest2154-21df_abs19:20:152
299779982,4cyclictest16996-21pluginstate19:55:212
299759985,2cyclictest0-21swapper/021:05:140
299759985,2cyclictest0-21swapper/020:30:010
299759984,3cyclictest7458-21runrttasks19:22:040
299759983,3cyclictest8330-21grep19:35:130
299759983,3cyclictest5868-21cut19:30:130
299759983,3cyclictest19250irq/25-ahci[00020:20:120
299759983,3cyclictest11393-21tail19:40:270
299759980,7cyclictest0-21swapper/020:25:410
299759980,2cyclictest0-21swapper/021:00:130
299759974,2cyclictest1776-21munin-node0
299759973,3cyclictest8404-21awk20:55:160
299759973,3cyclictest14585-21fschecks_time19:50:150
299759973,3cyclictest101ktimersoftd/019:55:140
299759970,6cyclictest0-21swapper/019:10:220
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional