You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-18 - 18:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Tue Nov 18, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4346211694,16sleep10-21swapper/107:06:531
4346211694,16sleep10-21swapper/107:06:531
45822114103,6sleep20-21swapper/207:09:422
45822114103,6sleep20-21swapper/207:09:422
4327211293,14sleep30-21swapper/307:06:393
4327211293,14sleep30-21swapper/307:06:393
4316210679,6sleep00-21swapper/007:06:320
4316210679,6sleep00-21swapper/007:06:320
87962730,1sleep221131-21diskmemload10:05:002
282842720,1sleep00-21swapper/010:25:150
153492720,1sleep1221ktimersoftd/112:26:411
129472680,1sleep20-21swapper/207:30:012
5202660,0sleep20-21swapper/212:11:032
4635992720,5cyclictest0-21swapper/209:25:102
463599261,23cyclictest0-21swapper/207:50:112
463599230,2cyclictest0-21swapper/211:00:132
4636992219,2cyclictest29919-21kworker/u8:111:56:043
4634992219,2cyclictest3451-21kworker/u8:012:21:051
4634992219,2cyclictest27538-21kworker/u8:208:09:041
4636992118,2cyclictest7373-21kworker/u8:109:22:053
4636992118,2cyclictest431-21kworker/u8:010:00:053
4636992118,2cyclictest29472-21kworker/u8:112:11:043
4636992118,2cyclictest23013-21kworker/u8:012:04:043
4636992118,2cyclictest17304-21kworker/u8:009:44:043
4636992118,2cyclictest13807-21kworker/u8:210:18:043
4636992118,2cyclictest13194-21kworker/u8:210:48:053
4636992118,2cyclictest10798-21kworker/u8:108:24:043
4633992118,2cyclictest24945-21kworker/u8:209:48:040
249942210,1sleep10-21swapper/110:55:181
4636992017,2cyclictest8023-21kworker/u8:110:06:053
4636992017,2cyclictest7373-21kworker/u8:109:15:043
4636992017,2cyclictest7032-21kworker/u8:009:31:043
4636992017,2cyclictest431-21kworker/u8:010:33:043
4636992017,2cyclictest431-21kworker/u8:010:20:013
4636992017,2cyclictest3451-21kworker/u8:012:22:043
4636992017,2cyclictest31037-21kworker/u8:110:54:033
4636992017,2cyclictest29472-21kworker/u8:112:32:043
4636992017,2cyclictest23013-21kworker/u8:012:05:043
4636992017,2cyclictest22782-21kworker/u8:007:52:043
4636992017,2cyclictest21427-21kworker/u8:209:28:053
4636992017,2cyclictest13807-21kworker/u8:210:12:043
4636992017,2cyclictest10798-21kworker/u8:107:33:043
463599200,18cyclictest0-21swapper/209:00:122
4634992017,2cyclictest431-21kworker/u8:009:59:041
4634992017,2cyclictest23013-21kworker/u8:011:39:041
463399200,18cyclictest0-21swapper/007:50:110
463699192,2cyclictest0-21swapper/311:39:043
4636991916,2cyclictest7373-21kworker/u8:109:50:043
4636991916,2cyclictest7373-21kworker/u8:108:59:043
4636991916,2cyclictest7159-21kworker/u8:007:44:013
4636991916,2cyclictest7159-21kworker/u8:007:27:043
4636991916,2cyclictest31037-21kworker/u8:110:39:043
4636991916,2cyclictest27219-21kworker/u8:207:22:043
4636991916,2cyclictest23013-21kworker/u8:011:48:053
4636991916,2cyclictest23013-21kworker/u8:011:34:043
4636991916,2cyclictest23013-21kworker/u8:011:28:043
463699190,2cyclictest0-21swapper/309:59:043
4634991916,2cyclictest31037-21kworker/u8:110:46:041
4633991916,2cyclictest7373-21kworker/u8:109:23:040
4633991916,2cyclictest431-21kworker/u8:010:09:030
4633991916,2cyclictest32594-21kworker/u8:111:20:040
4633991916,2cyclictest24945-21kworker/u8:209:52:050
4633991916,2cyclictest22782-21kworker/u8:007:56:040
4633991916,2cyclictest18411-21kworker/u8:010:50:040
4636991815,2cyclictest7373-21kworker/u8:109:10:043
4636991815,2cyclictest7373-21kworker/u8:109:08:043
4636991815,2cyclictest4525-21kworker/u8:008:28:043
4636991815,2cyclictest3451-21kworker/u8:012:28:043
4636991815,2cyclictest29472-21kworker/u8:112:18:043
4636991815,2cyclictest27538-21kworker/u8:208:16:013
4636991815,2cyclictest24132-21kworker/u8:211:05:043
4636991815,2cyclictest22641-21kworker/u8:012:39:043
4636991815,2cyclictest19181-21kworker/u8:207:46:043
4636991815,2cyclictest13807-21kworker/u8:210:25:043
4636991815,2cyclictest10798-21kworker/u8:108:01:043
463699181,2cyclictest0-21swapper/311:51:043
463699180,2cyclictest0-21swapper/309:35:043
4634991815,2cyclictest8023-21kworker/u8:110:08:011
4634991815,2cyclictest17304-21kworker/u8:009:47:041
4634991815,2cyclictest12271-21kworker/u8:209:35:041
4634991814,2cyclictest332250irq/24-eth111:56:031
4633991815,2cyclictest13807-21kworker/u8:210:17:040
4636991714,2cyclictest5917-21kworker/u8:011:16:043
4636991714,2cyclictest32594-21kworker/u8:111:12:053
4636991714,2cyclictest0-21swapper/310:57:043
463699170,2cyclictest0-21swapper/309:47:043
4634991714,2cyclictest22782-21kworker/u8:007:57:041
4634991714,2cyclictest22641-21kworker/u8:012:38:041
4633991714,2cyclictest7373-21kworker/u8:109:14:010
4633991714,2cyclictest7373-21kworker/u8:109:05:040
4633991714,2cyclictest24132-21kworker/u8:211:09:040
4633991714,2cyclictest24132-21kworker/u8:211:01:040
4633991714,2cyclictest17304-21kworker/u8:009:41:030
463399170,2cyclictest0-21swapper/011:51:040
4636991613,2cyclictest7373-21kworker/u8:108:50:043
4636991613,2cyclictest7373-21kworker/u8:108:44:043
4636991613,2cyclictest431-21kworker/u8:010:43:043
4636991613,2cyclictest19574-21kworker/u8:107:10:043
463699160,2cyclictest0-21swapper/307:57:043
463599161,13cyclictest11409-21hddtemp_smartct11:15:162
463499162,2cyclictest221ktimersoftd/109:12:051
4634991613,2cyclictest7373-21kworker/u8:108:52:041
4634991613,2cyclictest31037-21kworker/u8:110:44:051
4634991613,2cyclictest23013-21kworker/u8:012:03:041
4634991613,2cyclictest13807-21kworker/u8:210:24:041
4634991612,2cyclictest18775-21ntp_states12:30:221
463499160,1cyclictest332250irq/24-eth111:51:041
4633991613,2cyclictest7373-21kworker/u8:109:03:040
4633991613,2cyclictest5917-21kworker/u8:011:19:040
4633991613,2cyclictest431-21kworker/u8:009:58:040
4633991613,2cyclictest29919-21kworker/u8:111:41:040
4633991613,2cyclictest29472-21kworker/u8:112:31:040
4633991613,2cyclictest29472-21kworker/u8:112:10:040
4633991613,2cyclictest27538-21kworker/u8:208:18:040
4633991613,2cyclictest10798-21kworker/u8:108:23:040
4633991613,2cyclictest10798-21kworker/u8:107:37:040
463399160,2cyclictest1299-21ssh11:39:040
463399160,14cyclictest3597-21hddtemp_smartct08:25:180
463699151,12cyclictest5092-21dpkg08:30:123
463599153,7cyclictest22189-21ssh09:45:002
463599152,7cyclictest0-21swapper/207:20:012
4635991511,2cyclictest0-21swapper/212:30:152
4635991510,3cyclictest0-21swapper/211:28:582
4634991512,2cyclictest7373-21kworker/u8:109:01:041
4634991512,2cyclictest431-21kworker/u8:010:35:041
4634991512,2cyclictest431-21kworker/u8:010:13:041
4634991512,2cyclictest29919-21kworker/u8:111:49:041
4634991512,2cyclictest24132-21kworker/u8:211:06:031
4633991512,2cyclictest7373-21kworker/u8:109:17:030
4633991512,2cyclictest7373-21kworker/u8:108:56:040
4633991512,2cyclictest7373-21kworker/u8:108:54:040
4633991512,2cyclictest7373-21kworker/u8:108:48:040
4633991512,2cyclictest4324-21nscd10:30:120
4633991512,2cyclictest3451-21kworker/u8:012:23:030
4633991512,2cyclictest27219-21kworker/u8:207:23:040
4633991512,2cyclictest23013-21kworker/u8:011:47:040
4633991512,2cyclictest21427-21kworker/u8:209:28:010
4633991512,2cyclictest19574-21kworker/u8:107:12:040
4633991512,2cyclictest10798-21kworker/u8:108:12:010
463399151,12cyclictest7844-21ssh10:37:240
4633991510,3cyclictest20066-21apt-get11:25:060
4636991411,2cyclictest29919-21kworker/u8:111:42:033
463699140,2cyclictest0-21swapper/309:01:043
463699140,13cyclictest0-21swapper/308:11:033
463699140,12cyclictest15620-21ssh11:20:123
463599149,3cyclictest8441-21aten2.4_r3power12:20:152
463599149,3cyclictest7489-21cut11:45:162
463599149,3cyclictest32683-21ssh11:37:192
463599142,7cyclictest0-21swapper/208:55:002
463599141,11cyclictest27205-21ssh11:31:092
4635991410,2cyclictest0-21swapper/211:20:062
463599140,12cyclictest0-21swapper/212:02:302
463599140,12cyclictest0-21swapper/211:57:392
463599140,12cyclictest0-21swapper/208:30:262
4634991411,2cyclictest7373-21kworker/u8:108:57:041
4634991411,2cyclictest31037-21kworker/u8:110:30:041
4634991411,2cyclictest29472-21kworker/u8:112:12:051
4634991411,2cyclictest27538-21kworker/u8:208:38:041
4634991411,2cyclictest23013-21kworker/u8:011:44:041
4634991411,2cyclictest21131-21diskmemload10:04:031
4634991411,2cyclictest10798-21kworker/u8:108:26:031
4634991411,2cyclictest10798-21kworker/u8:108:21:041
4634991411,2cyclictest10798-21kworker/u8:107:32:011
4634991411,2cyclictest0-21swapper/111:19:311
4634991411,2cyclictest0-21swapper/110:51:131
4634991411,2cyclictest0-21swapper/109:25:121
4634991410,2cyclictest19103-21grep10:15:171
463499140,12cyclictest20101-21apt-get07:45:221
463499140,12cyclictest0-21swapper/112:15:581
463499140,12cyclictest0-21swapper/109:31:371
463499140,12cyclictest0-21swapper/109:22:051
4633991411,2cyclictest7159-21kworker/u8:007:16:040
4633991411,2cyclictest5917-21kworker/u8:011:10:040
4633991411,2cyclictest3451-21kworker/u8:012:17:040
4633991411,2cyclictest10798-21kworker/u8:108:05:040
463399140,9cyclictest0-21swapper/011:58:030
463399140,2cyclictest0-21swapper/012:35:170
463399140,2cyclictest0-21swapper/009:38:040
463399140,12cyclictest9935-21runrttasks09:30:430
463399140,12cyclictest4563-21ssh10:00:160
463399140,12cyclictest0-21swapper/011:33:060
4636991310,2cyclictest7373-21kworker/u8:108:36:043
4636991310,2cyclictest10798-21kworker/u8:107:36:053
463699130,1cyclictest0-21swapper/311:04:343
463599132,6cyclictest0-21swapper/209:10:002
4635991310,2cyclictest0-21swapper/211:51:002
4635991310,2cyclictest0-21swapper/210:42:572
4635991310,2cyclictest0-21swapper/210:15:382
4635991310,2cyclictest0-21swapper/209:58:182
4635991310,2cyclictest0-21swapper/207:40:162
463599130,2cyclictest21131-21diskmemload12:05:292
463599130,2cyclictest0-21swapper/212:27:292
463599130,2cyclictest0-21swapper/211:11:092
463599130,2cyclictest0-21swapper/210:21:492
463599130,2cyclictest0-21swapper/209:22:102
463599130,12cyclictest0-21swapper/210:46:282
463599130,11cyclictest7411-21ssh12:19:122
463599130,11cyclictest21131-21diskmemload11:41:502
463599130,11cyclictest21131-21diskmemload09:31:102
463499139,2cyclictest0-21swapper/112:10:001
4634991310,2cyclictest4525-21kworker/u8:008:30:041
4634991310,2cyclictest21131-21diskmemload09:50:011
4634991310,2cyclictest0-21swapper/111:26:021
4634991310,2cyclictest0-21swapper/108:10:271
463499130,2cyclictest0-21swapper/111:10:031
463499130,2cyclictest0-21swapper/108:00:241
463499130,2cyclictest0-21swapper/107:35:141
463499130,12cyclictest15293-21copy11:20:031
463499130,12cyclictest0-21swapper/111:00:201
463499130,12cyclictest0-21swapper/109:18:121
463499130,11cyclictest0-21swapper/110:26:331
4633991310,2cyclictest19181-21kworker/u8:207:48:040
4633991310,2cyclictest14923-21kworker/u8:212:26:010
4633991310,2cyclictest0-21swapper/012:06:040
463399130,2cyclictest14483-21ssh10:45:040
463399130,2cyclictest0-21swapper/010:59:380
463399130,2cyclictest0-21swapper/010:11:040
463399130,12cyclictest0-21swapper/007:34:040
266602130,0sleep00-21swapper/010:23:340
119612130,2sleep00-21swapper/010:41:230
4636991210,1cyclictest0-21swapper/308:05:273
463699120,10cyclictest0-21swapper/308:45:233
463599129,2cyclictest0-21swapper/212:36:082
463599129,2cyclictest0-21swapper/210:30:252
463599129,2cyclictest0-21swapper/209:42:502
463599122,7cyclictest0-21swapper/207:47:592
463599122,7cyclictest0-21swapper/207:11:592
463599122,6cyclictest2324-21sh11:05:282
463599122,6cyclictest0-21swapper/208:15:002
463599122,5cyclictest0-21swapper/207:25:012
463599120,2cyclictest0-21swapper/210:37:082
463599120,2cyclictest0-21swapper/210:25:192
463599120,2cyclictest0-21swapper/209:35:502
463599120,2cyclictest0-21swapper/209:11:492
463599120,11cyclictest301ktimersoftd/210:50:162
463599120,11cyclictest0-21swapper/210:56:082
463599120,11cyclictest0-21swapper/209:50:242
463599120,11cyclictest0-21swapper/209:16:292
463599120,11cyclictest0-21swapper/208:45:202
463599120,10cyclictest21131-21diskmemload10:10:222
463599120,10cyclictest0-21swapper/210:08:212
463499129,2cyclictest7159-21kworker/u8:007:19:041
463499129,2cyclictest0-21swapper/109:42:211
463499120,11cyclictest0-21swapper/111:32:091
463499120,11cyclictest0-21swapper/108:40:191
463399129,2cyclictest10798-21kworker/u8:107:40:010
463399129,2cyclictest0-21swapper/012:00:050
463399129,2cyclictest0-21swapper/008:00:130
463399120,2cyclictest0-21swapper/007:25:160
463699110,2cyclictest0-21swapper/307:19:043
463599118,2cyclictest0-21swapper/208:00:132
463599112,6cyclictest0-21swapper/208:00:012
463599110,10cyclictest0-21swapper/208:05:132
463499118,2cyclictest0-21swapper/107:50:221
463499118,2cyclictest0-21swapper/107:10:231
463499110,9cyclictest0-21swapper/107:20:111
463499110,2cyclictest0-21swapper/109:06:041
463499110,10cyclictest0-21swapper/107:27:041
463399118,2cyclictest4525-21kworker/u8:008:35:040
463399110,2cyclictest0-21swapper/008:43:040
463599107,2cyclictest0-21swapper/208:15:302
463599102,7cyclictest0-21swapper/208:42:592
463599101,7cyclictest0-21swapper/208:21:022
463599100,2cyclictest0-21swapper/207:30:242
463499107,2cyclictest0-21swapper/108:15:201
463499101,8cyclictest11253-21apt-get08:45:131
463499100,2cyclictest0-21swapper/107:40:111
46359994,3cyclictest3014-21dpkg08:25:142
46359994,3cyclictest16004-21ntp_kernel_pll_07:35:182
46359992,6cyclictest0-21swapper/208:57:022
46339994,3cyclictest6227-21pzem_voltage08:30:220
46359983,3cyclictest7343-21aten2.4_r3power08:35:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional