You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-27 - 00:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Thu Mar 26, 2026 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4754211696,15sleep00-21swapper/007:07:320
4944211593,17sleep30-21swapper/307:09:593
4942210796,6sleep10-21swapper/107:09:581
4746210594,6sleep20-21swapper/207:07:262
110652850,1sleep00-21swapper/010:40:000
248522730,0sleep10-21swapper/111:27:441
143552670,0sleep10-21swapper/109:35:171
43952630,5sleep0497299cyclictest11:05:460
4975993517,2cyclictest0-21swapper/308:15:123
497499330,31cyclictest0-21swapper/208:10:102
497299331,4cyclictest15262-21latency_hist07:35:010
497499280,2cyclictest0-21swapper/209:00:102
119152280,1sleep20-21swapper/207:25:152
497299250,4cyclictest9672-21grep11:45:180
497299241,3cyclictest0-21swapper/010:00:150
497299241,3cyclictest0-21swapper/007:20:130
497299230,3cyclictest8603-21rm09:30:100
497299230,3cyclictest0-21swapper/012:30:150
497299230,3cyclictest0-21swapper/010:55:140
497299230,3cyclictest0-21swapper/010:53:230
497299230,3cyclictest0-21swapper/010:41:140
497299220,3cyclictest32152-21fschecks_time08:15:140
497299220,3cyclictest2655-21awk08:21:030
497299220,3cyclictest21278-21ssh11:24:380
497299220,3cyclictest0-21swapper/012:20:220
497299220,3cyclictest0-21swapper/011:50:030
497299220,3cyclictest0-21swapper/011:35:140
497299220,3cyclictest0-21swapper/011:25:150
497299220,3cyclictest0-21swapper/011:14:460
497299220,3cyclictest0-21swapper/009:57:060
497299220,3cyclictest0-21swapper/009:10:070
497299220,3cyclictest0-21swapper/008:50:140
497299220,3cyclictest0-21swapper/007:50:140
497299220,2cyclictest0-21swapper/011:17:310
497299220,20cyclictest0-21swapper/011:31:280
148222220,0sleep30-21swapper/311:17:033
497299210,3cyclictest9950-21ssh10:05:100
497299210,3cyclictest6520-21ssh12:15:390
497299210,3cyclictest4708-21sed08:26:020
497299210,3cyclictest28899-21ssh09:16:500
497299210,3cyclictest28849-21sh12:05:180
497299210,3cyclictest1844-21ssh11:03:550
497299210,3cyclictest0-21swapper/012:28:420
497299210,3cyclictest0-21swapper/010:18:540
497299210,3cyclictest0-21swapper/009:45:220
497299210,2cyclictest17252-21ssh10:11:540
497299210,2cyclictest0-21swapper/011:43:550
497299210,2cyclictest0-21swapper/010:30:140
497299210,2cyclictest0-21swapper/010:26:350
497299210,2cyclictest0-21swapper/009:52:060
497299210,2cyclictest0-21swapper/008:30:110
4974992017,2cyclictest2224-21kworker/u8:210:00:042
4974992016,2cyclictest22251-21kworker/u8:010:33:042
497499200,18cyclictest0-21swapper/211:45:112
497299202,12cyclictest0-21swapper/007:29:590
497299200,3cyclictest3649-21snmpd07:12:380
497299200,2cyclictest26813-21kworker/u8:012:37:190
497299200,2cyclictest26813-21kworker/u8:012:37:180
497299200,2cyclictest21276-21diskmemload09:20:100
497299200,2cyclictest19955-21hddtemp_smartct07:45:150
497299200,2cyclictest0-21swapper/012:10:180
497299200,2cyclictest0-21swapper/012:00:500
497299200,2cyclictest0-21swapper/011:55:060
497299200,2cyclictest0-21swapper/010:23:260
497299200,2cyclictest0-21swapper/009:35:030
497299200,2cyclictest0-21swapper/009:25:260
497299200,2cyclictest0-21swapper/008:45:150
497299200,2cyclictest0-21swapper/008:35:190
497299200,2cyclictest0-21swapper/007:58:550
497299200,11cyclictest0-21swapper/008:05:160
4974991916,2cyclictest3849-21kworker/u8:111:50:052
4974991916,2cyclictest21223-21kworker/u8:212:15:052
4974991916,2cyclictest18714-21kworker/u8:010:48:012
497399193,2cyclictest21276-21diskmemload09:40:041
4973991916,2cyclictest0-21swapper/107:20:101
497399190,18cyclictest0-21swapper/109:00:101
497299190,2cyclictest20013-21ssh10:49:020
497299190,2cyclictest0-21swapper/008:55:100
497299190,2cyclictest0-21swapper/007:37:220
4974991815,2cyclictest541-21kworker/u8:110:42:042
4974991815,2cyclictest27335-21kworker/u8:009:53:042
4974991815,2cyclictest19189-21kworker/u8:209:17:042
4973991815,2cyclictest21976-21kworker/u8:211:39:041
497399180,16cyclictest0-21swapper/109:25:091
497299180,2cyclictest3649-21snmpd08:14:310
497299180,2cyclictest19485-21apt-get09:05:100
4974991714,2cyclictest5224-21kworker/u8:207:36:042
4974991714,2cyclictest4939-21kworker/u8:208:28:042
4974991714,2cyclictest18714-21kworker/u8:011:06:042
4973991714,2cyclictest2416-21kworker/u8:112:21:041
4973991714,2cyclictest20925-21kworker/u8:112:34:041
4973991714,2cyclictest18714-21kworker/u8:011:05:041
4973991714,2cyclictest15582-21kworker/u8:011:57:041
32822170,0sleep20-21swapper/211:39:442
497599161,3cyclictest25275-40update-apt-xapi07:59:133
4974991613,2cyclictest6615-21kworker/u8:210:53:042
4974991613,2cyclictest5704-21kworker/u8:111:25:052
4974991613,2cyclictest5704-21kworker/u8:111:22:052
4974991613,2cyclictest5224-21kworker/u8:207:15:052
4974991613,2cyclictest32514-21kworker/u8:009:33:042
4974991613,2cyclictest27424-21kworker/u8:210:25:052
4974991613,2cyclictest2224-21kworker/u8:209:57:052
4974991613,2cyclictest12487-21kworker/u8:209:38:052
4973991613,2cyclictest18714-21kworker/u8:010:50:051
4973991611,3cyclictest541-21kworker/u8:110:35:051
497399160,14cyclictest0-21swapper/110:47:251
497299160,14cyclictest17568-21tail09:00:110
497299160,14cyclictest0-21swapper/009:41:460
497599152,7cyclictest0-21swapper/307:45:003
497599151,12cyclictest29274-21ssh10:58:323
4975991511,2cyclictest0-21swapper/309:46:263
4975991510,3cyclictest0-21swapper/312:30:173
4974991512,2cyclictest32514-21kworker/u8:009:42:042
4974991512,2cyclictest27303-21kworker/u8:008:04:012
4974991512,2cyclictest21976-21kworker/u8:211:40:042
4974991512,2cyclictest21223-21kworker/u8:212:11:042
4974991512,2cyclictest20925-21kworker/u8:112:32:012
4974991512,2cyclictest17078-21kworker/u8:009:09:042
4974991512,2cyclictest12487-21kworker/u8:209:47:052
4974991512,2cyclictest10051-21kworker/u8:110:06:042
497499151,12cyclictest21278-21apt-get09:10:062
497399151,3cyclictest20842-21users07:46:031
4973991512,2cyclictest3849-21kworker/u8:111:51:051
4973991512,2cyclictest3849-21kworker/u8:111:48:051
4973991512,2cyclictest27303-21kworker/u8:008:41:041
4973991512,2cyclictest27303-21kworker/u8:008:24:051
4973991512,2cyclictest22251-21kworker/u8:010:19:041
4973991512,2cyclictest21263-21kworker/u8:109:52:011
4973991512,2cyclictest18714-21kworker/u8:011:03:051
4973991512,2cyclictest17078-21kworker/u8:009:10:051
497399150,13cyclictest0-21swapper/111:31:111
497299151,4cyclictest25686-21cut08:00:110
497299151,4cyclictest17940-21grep07:40:130
497299151,4cyclictest10039-21hwlatdetect08:40:130
497299151,3cyclictest0-21swapper/007:15:130
497599141,3cyclictest22396-21taskset09:44:293
4975991410,2cyclictest0-21swapper/309:38:043
497599140,2cyclictest31269-21apt-get09:20:123
497599140,12cyclictest21276-21diskmemload09:31:063
497599140,12cyclictest0-21swapper/309:15:123
497599140,12cyclictest0-21swapper/308:50:163
4974991411,2cyclictest9776-21kworker/u8:012:27:052
4974991411,2cyclictest5224-21kworker/u8:207:41:052
4974991411,2cyclictest31802-21kworker/u8:211:02:052
4974991411,2cyclictest27424-21kworker/u8:210:24:042
4974991411,2cyclictest27335-21kworker/u8:010:10:022
4974991411,2cyclictest27303-21kworker/u8:008:34:022
4974991411,2cyclictest27303-21kworker/u8:008:19:052
4974991411,2cyclictest23020-21kworker/u8:208:08:052
4974991411,2cyclictest17078-21kworker/u8:008:58:022
4974991411,2cyclictest15582-21kworker/u8:011:56:042
4974991411,2cyclictest13396-21kworker/u8:007:34:052
4974991411,2cyclictest0-21swapper/211:11:032
497499140,13cyclictest0-21swapper/207:45:122
497399141,2cyclictest17375-21apt-get07:40:101
497399141,2cyclictest16614-21smartctl08:56:011
4973991411,2cyclictest5704-21kworker/u8:111:22:011
4973991411,2cyclictest5704-21kworker/u8:111:14:041
4973991411,2cyclictest4939-21kworker/u8:208:38:041
4973991411,2cyclictest27424-21kworker/u8:210:27:051
4973991411,2cyclictest21559-21kworker/u8:109:20:061
497399140,2cyclictest15157-21sed07:35:001
497399140,12cyclictest13901-21fschecks_count08:50:141
497399140,12cyclictest0-21swapper/112:10:111
497399140,12cyclictest0-21swapper/109:58:351
497399140,10cyclictest0-21swapper/109:32:041
288542141,3sleep229080-21latency_hist12:40:012
497599133,6cyclictest0-21swapper/311:40:593
497599132,6cyclictest0-21swapper/311:50:013
497599132,6cyclictest0-21swapper/310:05:003
497599131,7cyclictest21317-21copy09:10:013
497599131,10cyclictest11174-21sh11:13:513
4975991310,2cyclictest0-21swapper/312:18:143
4975991310,2cyclictest0-21swapper/312:06:453
4975991310,2cyclictest0-21swapper/312:01:163
4975991310,2cyclictest0-21swapper/311:35:053
4975991310,2cyclictest0-21swapper/311:25:163
4975991310,2cyclictest0-21swapper/310:37:353
4975991310,2cyclictest0-21swapper/310:20:573
4975991310,2cyclictest0-21swapper/309:50:443
497599130,2cyclictest0-21swapper/311:57:333
497599130,2cyclictest0-21swapper/311:02:443
497599130,2cyclictest0-21swapper/310:49:153
497599130,12cyclictest21276-21diskmemload10:25:343
497599130,12cyclictest0-21swapper/312:25:163
497599130,11cyclictest0-21swapper/312:20:553
497599130,11cyclictest0-21swapper/310:42:253
4974991310,2cyclictest5224-21kworker/u8:207:20:042
4974991310,2cyclictest5224-21kworker/u8:207:14:042
4974991310,2cyclictest23020-21kworker/u8:207:55:052
4974991310,2cyclictest0-21swapper/212:24:062
4974991310,2cyclictest0-21swapper/212:07:362
4974991310,2cyclictest0-21swapper/210:35:182
497499130,3cyclictest1162-21sh09:21:402
497499130,2cyclictest0-21swapper/212:04:532
497499130,2cyclictest0-21swapper/211:18:422
497499130,2cyclictest0-21swapper/208:40:102
497399138,3cyclictest0-21swapper/107:59:101
497399132,9cyclictest0-21swapper/109:15:121
497399131,10cyclictest0-21swapper/108:30:131
4973991310,2cyclictest5704-21kworker/u8:111:15:051
4973991310,2cyclictest5224-21kworker/u8:207:12:011
4973991310,2cyclictest3849-21kworker/u8:111:44:051
4973991310,2cyclictest27840-21kworker/u8:012:06:051
4973991310,2cyclictest23020-21kworker/u8:208:12:041
4973991310,2cyclictest17078-21kworker/u8:009:07:041
4973991310,2cyclictest0-21swapper/112:39:251
4973991310,2cyclictest0-21swapper/112:39:241
497399130,8cyclictest0-21swapper/112:03:041
497399130,8cyclictest0-21swapper/110:58:041
497399130,12cyclictest0-21swapper/110:40:241
497399130,12cyclictest0-21swapper/109:45:151
102282130,2sleep30-21swapper/311:45:583
95592120,2sleep10-21swapper/110:04:561
497599129,2cyclictest0-21swapper/310:50:243
497599122,6cyclictest0-21swapper/308:36:003
497599120,2cyclictest23721-21ssh09:11:153
497599120,2cyclictest0-21swapper/311:30:183
497599120,2cyclictest0-21swapper/311:21:333
497599120,2cyclictest0-21swapper/310:31:233
497599120,2cyclictest0-21swapper/310:08:243
497599120,2cyclictest0-21swapper/309:57:073
497599120,2cyclictest0-21swapper/308:25:433
497599120,1cyclictest0-21swapper/309:26:433
497599120,11cyclictest0-21swapper/312:35:253
497599120,11cyclictest0-21swapper/312:35:243
497599120,11cyclictest0-21swapper/312:13:013
497599120,11cyclictest0-21swapper/310:17:243
497599120,11cyclictest0-21swapper/310:10:463
497599120,11cyclictest0-21swapper/309:00:133
497599120,11cyclictest0-21swapper/308:04:593
497499129,2cyclictest9041-21kworker/u8:108:52:042
497499128,2cyclictest0-21swapper/207:50:122
497499120,2cyclictest0-21swapper/212:36:272
497499120,2cyclictest0-21swapper/210:15:162
497499120,2cyclictest0-21swapper/209:26:012
497499120,11cyclictest0-21swapper/210:55:572
497399129,2cyclictest22251-21kworker/u8:010:31:041
497399129,2cyclictest0-21swapper/107:36:031
497399121,3cyclictest0-21swapper/108:25:131
497399120,2cyclictest0-21swapper/110:20:241
497399120,11cyclictest0-21swapper/112:25:051
497399120,11cyclictest0-21swapper/110:05:021
497399120,11cyclictest0-21swapper/108:45:171
497399120,11cyclictest0-21swapper/108:00:281
497399120,10cyclictest0-21swapper/112:15:081
497599118,2cyclictest0-21swapper/307:51:053
497599116,3cyclictest1773-21hddtemp_smartct08:20:143
497599116,3cyclictest11805-21grep07:25:143
497599112,7cyclictest0-21swapper/308:31:593
497599110,10cyclictest0-21swapper/311:06:153
497499118,2cyclictest1180-21kworker/u8:108:22:052
497499118,2cyclictest0-21swapper/211:32:312
497499118,2cyclictest0-21swapper/208:46:022
497399111,3cyclictest0-21swapper/110:10:171
497399111,3cyclictest0-21swapper/107:25:121
497599105,3cyclictest9590-21df_abs07:20:123
497599100,7cyclictest0-21swapper/308:13:583
497499107,2cyclictest0-21swapper/208:35:182
497399107,2cyclictest23020-21kworker/u8:208:07:051
497399101,7cyclictest7354-21aten2.4-expect07:15:141
497399101,7cyclictest32017-21df_inode08:15:131
497399100,8cyclictest0-21swapper/107:50:161
49759996,2cyclictest15114-21copy07:35:003
49759994,3cyclictest28768-21sensors_temp08:06:003
49759994,3cyclictest15447-21apt08:55:113
49759994,3cyclictest10201-21load08:40:163
49759994,3cyclictest0-21swapper/307:15:143
49759993,4cyclictest13708-21grep07:30:133
49759991,3cyclictest3728-21runrttasks08:45:233
49759983,3cyclictest19392-21basename07:45:113
49759981,3cyclictest5184-21taskset07:10:083
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional