You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-30 - 16:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Thu Apr 30, 2026 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
105322117106,6sleep20-21swapper/207:08:342
103572115104,6sleep10-21swapper/107:06:161
10562211188,18sleep00-21swapper/007:08:560
10401210581,19sleep30-21swapper/307:06:503
44402840,5sleep11067599cyclictest08:11:021
149032740,0sleep10-21swapper/109:32:111
267562720,0sleep00-21swapper/011:28:110
188702720,0sleep10-21swapper/110:10:241
63882710,0sleep10-21swapper/110:31:241
24932680,0sleep10-21swapper/111:36:131
1067599270,2cyclictest0-21swapper/109:25:121
320762260,1sleep229-21rcuc/210:59:592
150552220,1sleep20-21swapper/210:40:432
10676992118,2cyclictest25330-21kworker/u8:109:10:052
1067599210,19cyclictest0-21swapper/112:25:111
10676992017,2cyclictest13476-21kworker/u8:111:49:052
10676991916,2cyclictest12364-21kworker/u8:207:52:052
1067499190,18cyclictest0-21swapper/011:50:050
10676991815,2cyclictest6925-21kworker/u8:011:10:022
10676991815,2cyclictest10591-21kworker/u8:108:30:052
1067599181,3cyclictest0-21swapper/110:50:141
10675991813,3cyclictest4280-21kworker/u8:112:15:051
242002170,0sleep20-21swapper/210:16:022
10676991714,2cyclictest10699-21kworker/u8:010:02:042
1067799161,3cyclictest11663-21pzem_energy12:20:283
1067799161,3cyclictest0-21swapper/310:30:153
10677991611,3cyclictest17512-21hddtemp_smartct07:25:153
10676991613,2cyclictest32751-21needreboot10:25:162
10676991613,2cyclictest22243-21kworker/u8:012:34:042
10676991613,2cyclictest10591-21kworker/u8:108:37:042
10675991613,2cyclictest27346-21kworker/u8:210:27:041
10675991613,2cyclictest25132-21kworker/u8:211:32:051
10675991613,2cyclictest13112-21kworker/u8:011:00:051
10675991613,2cyclictest1063-21kworker/u8:111:21:051
10675991611,3cyclictest0-21swapper/111:05:141
10675991611,3cyclictest0-21swapper/108:15:151
1067599161,13cyclictest0-21swapper/107:30:181
1067599160,2cyclictest0-21swapper/112:31:041
1067599160,14cyclictest0-21swapper/109:35:161
1067499162,12cyclictest3127-21nscd10:47:050
10674991612,2cyclictest0-21swapper/008:45:150
58432151,3sleep20-21swapper/212:15:102
281252150,1sleep30-21swapper/309:11:423
1067799151,12cyclictest12352-21ssh11:12:403
10677991510,3cyclictest4562-21gdm-simple-gree12:08:583
10677991510,3cyclictest30441-21diskmemload11:31:313
10677991510,3cyclictest0-21swapper/312:33:483
10677991510,3cyclictest0-21swapper/311:46:373
10677991510,3cyclictest0-21swapper/310:35:453
1067799150,13cyclictest12866-21date07:14:593
10676991512,2cyclictest25132-21kworker/u8:211:29:042
10676991512,2cyclictest22243-21kworker/u8:012:39:052
10676991512,2cyclictest20517-21kworker/u8:212:13:052
10676991512,2cyclictest10008-21kworker/u8:107:11:042
1067699150,2cyclictest0-21swapper/211:19:042
1067599151,3cyclictest5906-21perl11:40:121
1067599150,13cyclictest25510-21diskmemload11:14:551
1067599150,13cyclictest0-21swapper/108:05:131
109862140,2sleep011096-21pzem_current11:45:190
1067799149,3cyclictest10884-21ssh09:27:573
1067799142,7cyclictest0-21swapper/309:55:013
1067799141,2cyclictest0-21swapper/312:14:113
10677991411,2cyclictest0-21swapper/311:05:433
1067799141,11cyclictest20961-21ssh10:13:033
10677991410,2cyclictest25510-21diskmemload11:28:353
1067799140,3cyclictest5794-21sh12:15:093
1067799140,2cyclictest0-21swapper/310:05:263
1067799140,12cyclictest31771-21ssh10:59:283
1067799140,12cyclictest25931-21sh09:44:333
1067799140,12cyclictest25931-21sh09:44:323
1067799140,12cyclictest17147-21ssh12:26:053
1067799140,12cyclictest0-21swapper/310:15:173
1067799140,12cyclictest0-21swapper/308:10:483
10676991411,2cyclictest9150-21kworker/u8:209:50:022
10676991411,2cyclictest4748-21kworker/u8:208:15:052
10676991411,2cyclictest30651-21kworker/u8:011:44:042
10676991411,2cyclictest25132-21kworker/u8:211:38:062
10676991411,2cyclictest21926-21kworker/u8:109:48:042
10676991411,2cyclictest16364-21kworker/u8:009:39:052
10676991411,2cyclictest14464-21kworker/u8:007:19:052
10676991411,2cyclictest13112-21kworker/u8:010:54:042
10676991411,2cyclictest12364-21kworker/u8:207:26:042
1067699141,12cyclictest10647-21ssh10:36:012
10676991411,2cyclictest0-21swapper/212:25:152
10676991411,2cyclictest0-21swapper/211:30:172
10676991411,2cyclictest0-21swapper/209:25:262
10676991411,2cyclictest0-21swapper/208:20:172
1067699140,2cyclictest0-21swapper/212:01:482
1067699140,2cyclictest0-21swapper/210:34:052
1067699140,2cyclictest0-21swapper/209:44:372
1067699140,2cyclictest0-21swapper/209:44:362
1067699140,13cyclictest0-21swapper/211:54:172
1067699140,13cyclictest0-21swapper/208:25:162
1067699140,12cyclictest20294-21hwlatdetect08:55:132
10675991411,2cyclictest8568-21kworker/u8:209:06:041
10675991411,2cyclictest17105-21kworker/u8:011:18:051
10675991411,2cyclictest0-21swapper/109:43:351
10675991411,2cyclictest0-21swapper/109:43:341
1067599140,13cyclictest0-21swapper/110:42:041
1067599140,13cyclictest0-21swapper/107:52:441
1067599140,12cyclictest25232-21apt-get07:45:101
1067599140,12cyclictest0-21swapper/111:45:161
1067599140,12cyclictest0-21swapper/110:01:041
1067499140,12cyclictest28590-21ssh09:46:120
1067499140,12cyclictest24027-21ssh09:41:310
1067499140,12cyclictest24027-21ssh09:41:300
1067499140,12cyclictest10202-21ssh12:20:010
1067499140,12cyclictest0-21swapper/012:29:510
1067499140,12cyclictest0-21swapper/009:57:360
1067799139,3cyclictest20517-21kworker/u8:212:01:593
1067799131,7cyclictest0-21swapper/308:20:003
1067799131,2cyclictest4612-21ssh11:39:243
10677991310,2cyclictest0-21swapper/312:35:143
10677991310,2cyclictest0-21swapper/311:40:123
10677991310,2cyclictest0-21swapper/311:02:303
10677991310,2cyclictest0-21swapper/310:20:433
10677991310,2cyclictest0-21swapper/309:55:413
10677991310,2cyclictest0-21swapper/309:24:283
1067799130,2cyclictest0-21swapper/310:47:163
1067799130,2cyclictest0-21swapper/310:40:123
1067799130,2cyclictest0-21swapper/309:19:483
1067799130,12cyclictest0-21swapper/311:23:463
1067799130,12cyclictest0-21swapper/307:31:033
1067799130,11cyclictest31566-21copy10:25:033
1067799130,11cyclictest14100-21ssh11:15:083
1067699139,3cyclictest23457-21sort07:40:142
10676991310,2cyclictest8568-21kworker/u8:208:42:052
10676991310,2cyclictest3841-21kworker/u8:109:57:052
10676991310,2cyclictest31-21ksoftirqd/211:56:052
10676991310,2cyclictest20517-21kworker/u8:212:08:042
10676991310,2cyclictest18592-21kworker/u8:110:46:052
10676991310,2cyclictest18516-21kworker/u8:007:31:052
10676991310,2cyclictest17105-21kworker/u8:011:20:062
10676991310,2cyclictest16794-21kworker/u8:108:47:052
10676991310,2cyclictest1063-21kworker/u8:111:05:052
10676991310,2cyclictest0-21swapper/210:20:372
10676991310,2cyclictest0-21swapper/210:13:462
10676991310,2cyclictest0-21swapper/210:05:572
10676991310,2cyclictest0-21swapper/209:30:152
1067699130,12cyclictest0-21swapper/212:23:102
10675991310,2cyclictest28708-21apt-get12:05:101
10675991310,2cyclictest25510-21diskmemload11:59:351
10675991310,2cyclictest25132-21kworker/u8:211:28:021
10675991310,2cyclictest10591-21kworker/u8:108:35:051
10675991310,2cyclictest0-21swapper/112:01:521
10675991310,2cyclictest0-21swapper/109:53:541
10675991310,2cyclictest0-21swapper/109:20:551
10675991310,2cyclictest0-21swapper/109:15:161
10675991310,2cyclictest0-21swapper/108:00:121
10675991310,2cyclictest0-21swapper/107:40:141
1067599130,2cyclictest0-21swapper/112:35:171
1067599130,2cyclictest0-21swapper/110:36:551
1067599130,2cyclictest0-21swapper/107:20:161
1067599130,12cyclictest0-21swapper/111:52:251
1067599130,12cyclictest0-21swapper/109:10:351
1067599130,12cyclictest0-21swapper/108:45:121
1067599130,12cyclictest0-21swapper/108:45:001
1067599130,11cyclictest0-21swapper/110:09:411
1067599130,11cyclictest0-21swapper/109:45:501
1067499131,2cyclictest0-21swapper/009:32:270
1067499131,2cyclictest0-21swapper/009:16:530
10674991310,2cyclictest25510-21diskmemload10:08:420
10674991310,2cyclictest0-21swapper/011:32:250
10674991310,2cyclictest0-21swapper/011:21:380
10674991310,2cyclictest0-21swapper/011:15:060
10674991310,2cyclictest0-21swapper/010:55:410
10674991310,2cyclictest0-21swapper/009:27:300
1067499130,2cyclictest0-21swapper/012:02:560
1067499130,2cyclictest0-21swapper/011:58:170
1067499130,2cyclictest0-21swapper/009:50:350
1067499130,12cyclictest0-21swapper/012:13:510
1067499130,12cyclictest0-21swapper/010:12:530
225292120,2sleep10-21swapper/110:49:371
1067799129,2cyclictest0-21swapper/311:55:163
1067799129,2cyclictest0-21swapper/310:00:083
1067799129,2cyclictest0-21swapper/309:32:563
1067799129,2cyclictest0-21swapper/307:55:293
1067799127,3cyclictest15136-21ssh11:50:143
1067799122,7cyclictest19550-21ssh09:36:593
1067799122,7cyclictest0-21swapper/308:51:013
1067799122,7cyclictest0-21swapper/308:41:593
1067799120,2cyclictest0-21swapper/310:50:013
1067799120,11cyclictest0-21swapper/309:46:223
1067799120,11cyclictest0-21swapper/308:45:513
1067799120,11cyclictest0-21swapper/308:05:173
1067799120,11cyclictest0-21swapper/307:35:173
1067699129,2cyclictest8568-21kworker/u8:209:01:042
1067699129,2cyclictest28949-21kworker/u8:007:55:052
1067699129,2cyclictest0-21swapper/209:23:062
1067699129,2cyclictest0-21swapper/207:35:162
1067699120,2cyclictest0-21swapper/209:17:062
1067699120,2cyclictest0-21swapper/207:21:022
1067699120,11cyclictest0-21swapper/211:00:142
1067599129,2cyclictest0-21swapper/107:10:091
1067599127,3cyclictest24902-21sh10:16:511
1067599121,9cyclictest3728-21runrttasks09:01:041
1067599121,9cyclictest1355-21diskstats12:10:151
1067599121,9cyclictest0-21swapper/108:20:181
1067599121,5cyclictest0-21swapper/110:20:011
1067599120,2cyclictest0-21swapper/110:57:571
1067499129,2cyclictest4414-21ssh09:20:530
1067499129,2cyclictest25510-21diskmemload12:05:170
1067499129,2cyclictest25510-21diskmemload10:51:050
1067499129,2cyclictest0-21swapper/011:35:530
1067499129,2cyclictest0-21swapper/011:10:150
1067499129,2cyclictest0-21swapper/011:05:140
1067499129,2cyclictest0-21swapper/010:26:400
1067499129,2cyclictest0-21swapper/010:15:140
1067499129,2cyclictest0-21swapper/010:01:290
1067499129,2cyclictest0-21swapper/008:40:140
1067499120,2cyclictest0-21swapper/008:06:010
1067499120,2cyclictest0-21swapper/007:55:490
1067499120,11cyclictest4054-21ssh10:30:040
1067499120,11cyclictest25510-21diskmemload12:30:070
1067499120,11cyclictest25510-21diskmemload09:10:050
1067499120,11cyclictest10591-21kworker/u8:108:27:040
1067499120,11cyclictest0-21swapper/012:35:200
1067499120,11cyclictest0-21swapper/012:20:080
1067499120,11cyclictest0-21swapper/011:41:500
1067499120,11cyclictest0-21swapper/011:00:080
1067499120,11cyclictest0-21swapper/010:40:090
1067499120,11cyclictest0-21swapper/010:35:110
1067499120,11cyclictest0-21swapper/010:20:320
1067499120,11cyclictest0-21swapper/009:37:340
1067499120,11cyclictest0-21swapper/008:30:170
1067499120,11cyclictest0-21swapper/008:00:160
1067499120,11cyclictest0-21swapper/007:50:140
1067499120,11cyclictest0-21swapper/007:35:390
1067499120,10cyclictest0-21swapper/008:55:090
1067799118,2cyclictest0-21swapper/309:00:003
1067799118,2cyclictest0-21swapper/307:43:593
1067799118,2cyclictest0-21swapper/307:16:033
1067799112,7cyclictest0-21swapper/308:01:583
1067799111,6cyclictest0-21swapper/307:45:593
1067699115,4cyclictest4441-21munin-node2
1067699110,2cyclictest0-21swapper/209:05:452
1067699110,2cyclictest0-21swapper/208:07:052
1067599117,2cyclictest0-21swapper/108:56:001
1067599117,2cyclictest0-21swapper/107:15:161
1067599116,3cyclictest12908-21latency_hist08:35:001
1067599111,5cyclictest0-21swapper/108:29:591
1067599110,9cyclictest29245-21munin-node1
1067599110,9cyclictest16933-21munin-node1
1067599110,9cyclictest0-21swapper/112:20:151
1067599110,3cyclictest0-21swapper/107:35:161
1067599110,10cyclictest0-21swapper/109:55:431
1067499118,2cyclictest0-21swapper/009:00:400
1067499118,2cyclictest0-21swapper/007:46:010
1067499110,10cyclictest2486-21kworker/u8:108:21:050
252362100,2sleep20-21swapper/207:45:122
1067799107,2cyclictest0-21swapper/308:30:113
1067799105,3cyclictest25503-21cron09:10:003
1067799105,3cyclictest16007-21rt-features07:20:593
1067699105,3cyclictest31801-21grep08:00:142
106779994,3cyclictest7058-21aten2.4_r3power08:20:123
106779994,3cyclictest19950-21tr08:55:103
106779994,3cyclictest0-21swapper/308:25:133
106779994,3cyclictest0-21swapper/307:50:143
106779991,5cyclictest0-21swapper/308:35:113
106759991,6cyclictest0-21swapper/108:53:091
106749996,2cyclictest0-21swapper/008:15:490
106749995,3cyclictest13950-21seq07:15:470
106749994,3cyclictest23490-21grep07:40:140
106749994,3cyclictest11231-21df_abs07:10:100
106769983,3cyclictest19075-21chrt08:50:042
106749985,2cyclictest3796-21ntpq08:10:160
106749985,2cyclictest0-21swapper/008:50:430
106749984,2cyclictest15879-21processes07:20:180
106749983,3cyclictest23884-21cpu09:05:120
106749983,3cyclictest20930-21cut07:35:000
106749983,3cyclictest13218-21aten2.4_r3power08:35:130
106749973,2cyclictest17233-21cpuspeed_turbos07:25:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional