You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-05 - 10:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7.osadl.org (updated Mon Jan 05, 2026 00:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
198899911255,48cyclictest23235-21ssh21:55:060
198899911053,51cyclictest374-21sshd20:05:010
19889991102,28cyclictest11708-21ssh22:28:450
19889991102,26cyclictest23496-21runrttasks20:58:360
19889991093,26cyclictest23617-21ssh00:30:350
19889991086,10cyclictest0-21swapper/019:09:500
19889991073,23cyclictest21417-21ssh22:44:430
19889991072,25cyclictest9382-21ssh23:15:330
19889991072,25cyclictest7814-21ssh22:21:410
198899910650,49cyclictest4366-21ntp_kernel_err00:00:180
19889991062,25cyclictest31759-21ssh23:52:070
19889991062,25cyclictest30602-21ssh22:05:510
19889991052,25cyclictest29471-21ssh23:49:150
19889991052,25cyclictest15399-21taskset20:33:180
19889991052,25cyclictest15399-21taskset20:33:180
19889991052,23cyclictest1367-21ssh22:11:090
19889991052,21cyclictest14680-21ssh21:40:390
2329921040,6sleep10-21swapper/123:39:251
2329921040,6sleep10-21swapper/123:39:251
198979910438,43cyclictest28948-21kworker/u17:0-rpciod21:19:321
198899910448,50cyclictest1205-21sh21:20:090
198899910448,50cyclictest1205-21sh21:20:090
198899910448,45cyclictest0-21swapper/019:40:220
19889991042,26cyclictest13569-21ssh22:30:280
19889991042,23cyclictest17424-21ssh22:37:280
19889991042,22cyclictest26292-21ssh23:44:040
198899910344,50cyclictest0-21swapper/021:50:100
198899910344,50cyclictest0-21swapper/021:50:100
19889991034,22cyclictest14383-21ssh00:15:520
19889991034,22cyclictest14383-21ssh00:15:520
19889991032,25cyclictest19522-21ssh23:32:400
19889991032,23cyclictest27218-21ssh00:36:160
19889991032,22cyclictest13723-21taskset20:27:240
19889991023,23cyclictest30496-21/usr/sbin/munin21:15:080
19889991023,22cyclictest9562-21ssh00:09:320
19889991023,22cyclictest9562-21ssh00:09:320
19889991023,20cyclictest28076-21ssh22:02:240
19889991023,20cyclictest28076-21ssh22:02:240
19889991022,25cyclictest29651-21ssh22:56:150
19889991022,25cyclictest29651-21ssh22:56:150
19889991022,21cyclictest29791-21ssh21:14:210
19889991013,26cyclictest10995-21/usr/sbin/munin00:10:230
19889991013,22cyclictest3707-21ssh23:06:570
19889991012,23cyclictest12222-21taskset20:23:480
19889991012,21cyclictest22167-21ssh23:36:260
19889991012,21cyclictest22167-21ssh23:36:260
19889991003,22cyclictest2777-21ssh23:58:050
19889991003,20cyclictest16238-21ssh23:27:110
19889999942,48cyclictest0-21swapper/023:24:490
19889999942,48cyclictest0-21swapper/023:24:490
1988999993,23cyclictest23255-21taskset19:17:140
1988999993,23cyclictest23255-21taskset19:17:140
1988999993,22cyclictest3866-21taskset19:58:370
1988999992,25cyclictest21981-21sh00:29:280
1988999992,23cyclictest13053-21ssh21:39:370
1988999992,22cyclictest4660-21ssh22:16:390
19889999844,45cyclictest0-21swapper/021:25:220
1988999983,21cyclictest17401-21ssh00:20:340
1988999982,31cyclictest5150-21ssh23:10:040
1988999982,26cyclictest1231-21taskset23:03:360
1988999982,24cyclictest9803-21ssh21:34:170
1988999982,24cyclictest21239-21taskset19:12:400
1988999982,24cyclictest10499-21taskset20:17:370
19903999755,35cyclictest0-21swapper/222:20:112
19889999745,45cyclictest0-21swapper/022:50:210
19889999745,45cyclictest0-21swapper/022:50:210
1988999972,27cyclictest8991-21runrttasks20:14:020
1988999972,25cyclictest24557-21ls19:20:250
1988999972,21cyclictest21843-21taskset20:53:000
1897029711,43sleep20-21swapper/219:05:292
1990399963,47cyclictest13504-21sh21:40:022
1988999962,24cyclictest26554-21taskset21:06:050
189002968,61sleep118923-21/usr/sbin/munin19:05:241
1988999952,27cyclictest352-21runrttasks20:38:180
61492940,5sleep16126-21ssh22:19:511
1988999942,25cyclictest5511-21runrttasks20:03:420
19897999354,32cyclictest0-21swapper/122:40:181
1989799932,61cyclictest25929-21ssh00:35:221
19889999340,45cyclictest0-21swapper/019:25:270
1988999933,25cyclictest20262-21runrttasks20:48:220
1988999932,28cyclictest352-21runrttasks21:01:190
1988999932,28cyclictest352-21runrttasks21:01:190
19897999243,38cyclictest6053-21gpgv20:04:511
19897999241,43cyclictest22732-21latency_hist21:54:511
19897999241,43cyclictest22732-21latency_hist21:54:511
19889999243,42cyclictest32404-21sh19:45:160
1988999922,23cyclictest29845-21taskset19:38:240
1990399905,38cyclictest32409-21/usr/sbin/munin22:10:172
1988999903,29cyclictest24548-21modprobe22:49:460
19897998945,37cyclictest983-21acpi21:19:591
19897998945,37cyclictest983-21acpi21:19:591
19897998847,34cyclictest15348-21sh22:34:501
19897998743,36cyclictest0-21swapper/120:35:281
19897998740,39cyclictest0-21swapper/100:29:471
19889998739,43cyclictest0-21swapper/019:34:490
19889998739,43cyclictest0-21swapper/019:34:490
1988999873,27cyclictest16780-21sh21:44:540
19889998711,25cyclictest18622-21seq20:43:010
1990399863,38cyclictest14210-21ssh00:15:272
1990399863,38cyclictest14210-21ssh00:15:272
19897998644,36cyclictest26860-21diskmemload22:45:511
19897998643,37cyclictest352-21runrttasks23:47:571
1989799862,74cyclictest0-21swapper/122:59:581
1988999862,28cyclictest1011-21/usr/sbin/munin19:50:320
19903998530,48cyclictest0-21swapper/200:10:162
19897998546,33cyclictest26860-21diskmemload00:04:421
19897998540,37cyclictest0-21swapper/119:45:221
19903998464,9cyclictest0-21swapper/221:19:502
19903998447,30cyclictest0-21swapper/223:59:182
1990399844,37cyclictest352-21runrttasks22:50:542
1990399844,37cyclictest352-21runrttasks22:50:542
1990399843,30cyclictest10251-21latency_hist21:34:512
1990399842,41cyclictest9582-21fschecks_count22:25:102
19903998416,25cyclictest17714-21cat23:30:032
19897998454,22cyclictest1-21systemd23:58:131
19903998365,12cyclictest17157-21systemctl20:39:462
19903998359,10cyclictest0-21swapper/222:39:462
1990399834,35cyclictest3198-21cstates22:15:042
1990399833,35cyclictest19213-21fschecks_count20:45:072
19897998341,34cyclictest0-21swapper/121:25:231
19897998340,36cyclictest0-21swapper/123:15:041
19897998340,35cyclictest0-21swapper/122:50:201
19897998340,35cyclictest0-21swapper/122:50:201
19897998338,38cyclictest0-21swapper/100:17:011
19897998338,38cyclictest0-21swapper/100:17:011
1990399823,38cyclictest974-21/usr/sbin/munin21:20:132
1990399823,38cyclictest974-21/usr/sbin/munin21:20:132
1990399823,27cyclictest24852-21grep21:00:262
1990399823,27cyclictest24852-21grep21:00:262
1990399823,26cyclictest8146-21rm23:14:512
19903998230,44cyclictest0-21swapper/223:45:172
1990399822,39cyclictest352-21runrttasks00:00:192
1990399822,33cyclictest22567-21runrttasks19:15:172
1990399822,33cyclictest22567-21runrttasks19:15:172
19910998118,41cyclictest0-21swapper/300:35:063
19903998165,9cyclictest0-21swapper/223:25:222
19903998161,14cyclictest19880-21cyclictest00:39:492
1990399814,38cyclictest5610-21latency_hist20:04:502
19903998137,37cyclictest10865-21sh21:35:162
1990399813,40cyclictest352-21runrttasks20:30:142
1990399813,40cyclictest352-21runrttasks20:30:142
1990399813,40cyclictest29510-21sh22:05:062
1990399813,37cyclictest11759-21ssh23:20:132
1990399813,37cyclictest11759-21ssh23:20:132
1990399813,29cyclictest10726-21modprobe20:19:472
1990399813,28cyclictest28815-21ssh22:55:392
1990399813,28cyclictest28815-21ssh22:55:392
1990399813,26cyclictest21656-21munin-node20:04:582
1990399813,25cyclictest2426-21/usr/sbin/munin23:05:132
19903998117,28cyclictest28492-21diskmemload21:10:552
19903998113,28cyclictest23955-21fschecks_count19:20:112
19897998140,33cyclictest0-21swapper/123:50:191
19897998138,36cyclictest26860-21diskmemload00:23:221
19897998137,36cyclictest0-21swapper/120:14:471
19903998053,16cyclictest0-21swapper/200:31:452
1990399805,10cyclictest0-21swapper/221:50:042
1990399805,10cyclictest0-21swapper/221:50:042
1990399804,36cyclictest20635-21/usr/sbin/munin23:34:572
1990399804,36cyclictest20635-21/usr/sbin/munin23:34:572
1990399804,30cyclictest12407-21/usr/sbin/munin22:30:252
1990399804,27cyclictest16272-21apt-get21:44:582
19903998037,36cyclictest0-21swapper/222:04:502
19903998037,36cyclictest0-21swapper/222:04:502
1990399803,31cyclictest29973-21/usr/sbin/munin23:50:032
1990399803,29cyclictest7720-21ssh00:05:222
1990399803,29cyclictest7720-21ssh00:05:222
1990399803,28cyclictest3980-21munin-run19:59:472
1990399803,27cyclictest27246-21fschecks_time19:30:102
1990399803,27cyclictest27246-21fschecks_time19:30:102
19903998032,41cyclictest0-21swapper/223:12:182
19897998040,35cyclictest21656-21munin-node23:32:261
19897998040,33cyclictest0-21swapper/121:35:051
19897998040,32cyclictest0-21swapper/119:30:091
19897998040,32cyclictest0-21swapper/119:30:091
19897998039,33cyclictest0-21swapper/122:00:141
19897998039,33cyclictest0-21swapper/122:00:141
1990399794,35cyclictest22418-21ssh22:45:192
1990399794,28cyclictest20845-21tune2fs20:50:092
1990399794,26cyclictest11222-21fschecks_time20:20:112
1990399794,25cyclictest30015-21modprobe19:39:472
19903997936,36cyclictest0-21swapper/219:40:172
1990399793,28cyclictest22540-21grep20:55:102
1990399793,28cyclictest12803-21cut20:25:102
1990399793,27cyclictest352-21runrttasks19:50:152
1990399793,25cyclictest4367-21fschecks_count21:25:092
19903997910,37cyclictest31334-21/usr/sbin/munin22:59:582
19897997940,33cyclictest26388-21kworker/u19:2-nfsiod00:13:031
19897997940,32cyclictest0-21swapper/121:00:251
19897997940,32cyclictest0-21swapper/121:00:251
1989799793,66cyclictest0-21swapper/119:55:041
1989799793,65cyclictest0-21swapper/122:35:031
1989799793,65cyclictest0-21swapper/119:50:051
1989799793,55cyclictest17240-21cpu21:46:031
19897997935,35cyclictest0-21swapper/121:39:581
19910997824,32cyclictest0-21swapper/321:46:043
1990399784,36cyclictest25616-21/usr/sbin/munin21:05:092
1990399784,25cyclictest16210-21/usr/sbin/munin00:20:142
1990399783,26cyclictest22109-21latency_hist00:29:492
1990399783,25cyclictest23781-21/usr/sbin/munin23:40:042
1990399782,24cyclictest26361-21taskset19:25:292
19897997855,15cyclictest200-21systemd-journal21:57:271
19897997842,31cyclictest19880-21cyclictest20:50:091
19897997839,32cyclictest0-21swapper/121:09:491
19897997839,31cyclictest0-21swapper/100:09:501
19897997839,31cyclictest0-21swapper/100:09:501
19897997837,35cyclictest13340-21timerandwakeup20:25:231
19897997837,34cyclictest4134-21sh23:08:051
19903997760,11cyclictest19436-21sendmail_mailtr22:40:232
1990399775,25cyclictest20297-21fschecks_time19:10:082
1990399773,37cyclictest23074-21ssh21:55:022
1990399773,25cyclictest17650-21fschecks_count20:40:102
1990399772,27cyclictest32520-21mailstats19:45:192
1990399772,26cyclictest7840-21chrt20:10:072
19897997740,30cyclictest0-21swapper/123:20:241
19897997740,30cyclictest0-21swapper/123:20:241
19897997740,30cyclictest0-21swapper/119:25:121
19897997641,27cyclictest0-21swapper/121:10:141
1989799763,68cyclictest0-21swapper/100:29:591
19897997632,36cyclictest0-21swapper/120:15:271
1989799762,57cyclictest28200-21apt-get22:55:131
1989799762,57cyclictest28200-21apt-get22:55:131
1989799762,39cyclictest0-21swapper/123:43:311
19910997512,40cyclictest0-21swapper/322:55:053
19910997512,40cyclictest0-21swapper/322:55:053
1989799752,68cyclictest0-21swapper/122:10:001
19897997435,31cyclictest0-21swapper/123:29:491
1989799733,64cyclictest0-21swapper/120:30:011
1989799733,64cyclictest0-21swapper/120:30:011
19897997335,30cyclictest0-21swapper/120:05:351
19897997248,17cyclictest23708-21latency_hist20:59:491
19897997232,27cyclictest32089-21modprobe22:09:461
19897997230,36cyclictest0-21swapper/119:20:221
1989799722,37cyclictest0-21swapper/121:32:581
1989799712,64cyclictest0-21swapper/119:15:041
1989799712,64cyclictest0-21swapper/119:15:041
19897997122,43cyclictest0-21swapper/122:25:241
1989799702,63cyclictest0-21swapper/120:40:011
19897996932,30cyclictest0-21swapper/119:40:131
19897996930,31cyclictest0-21swapper/122:23:161
19897996929,34cyclictest0-21swapper/119:35:051
19897996926,35cyclictest0-21swapper/119:10:191
1941426912,39sleep30-21swapper/319:05:383
19897996831,29cyclictest0-21swapper/120:20:131
19897996821,40cyclictest5393-21cut23:10:141
1989799663,55cyclictest19200-21cat20:45:061
11602560,14sleep3451rcuc/323:03:253
1991099552,39cyclictest1281-21chrt21:20:113
1991099552,39cyclictest1281-21chrt21:20:113
1991099543,39cyclictest4926-21chrt23:09:493
1991099543,37cyclictest13657-21chrt21:40:063
1991099542,38cyclictest20777-21chrt20:50:053
19910995341,8cyclictest451rcuc/300:29:333
1991099533,38cyclictest694-21chrt23:55:043
1991099533,33cyclictest4217-21chrt19:59:513
1991099532,38cyclictest9994-21taskset21:34:463
1991099523,40cyclictest9793-21taskset20:15:183
1991099523,37cyclictest23258-21taskset22:46:233
1991099523,36cyclictest7396-21taskset23:13:303
1991099523,36cyclictest22582-21chrt20:55:113
1991099523,35cyclictest28799-21taskset21:11:443
1991099523,34cyclictest21416-21chrt19:14:473
1991099513,35cyclictest30965-21taskset21:15:213
1991099513,35cyclictest24349-21chrt00:32:323
1991099513,35cyclictest23294-21chrt21:55:093
1991099513,35cyclictest18966-21taskset22:40:113
1991099513,34cyclictest7066-21chrt00:05:053
1991099513,34cyclictest7066-21chrt00:05:053
1991099513,33cyclictest26856-21chrt23:44:543
1991099512,36cyclictest25468-21chrt19:25:083
1991099503,34cyclictest15913-21taskset23:26:193
1991099503,33cyclictest1012-21chrt19:50:033
1991099502,38cyclictest19933-21taskset23:33:443
1991099502,35cyclictest28327-21chrt22:03:033
1991099502,35cyclictest28327-21chrt22:03:033
1991099493,36cyclictest16290-21taskset20:35:273
1991099493,35cyclictest12474-21chrt23:20:273
1991099493,35cyclictest12474-21chrt23:20:273
1991099493,34cyclictest4610-21taskset21:25:143
1991099493,34cyclictest29688-21taskset22:05:103
1991099493,33cyclictest16278-21chrt00:20:043
1991099493,33cyclictest15759-21taskset20:34:503
1991099493,32cyclictest16249-21chrt22:35:213
1991099492,35cyclictest19145-21chrt20:45:033
1991099492,34cyclictest7698-21chrt22:21:233
1991099492,34cyclictest23617-21chrt19:19:493
1991099492,34cyclictest23617-21chrt19:19:493
1991099492,34cyclictest10746-21taskset22:26:133
1991099483,34cyclictest31715-21chrt23:52:003
1991099483,33cyclictest25379-21taskset22:50:123
1991099483,33cyclictest25379-21taskset22:50:123
1991099483,32cyclictest15279-21taskset00:18:143
1991099483,32cyclictest15279-21taskset00:18:143
1991099483,31cyclictest5071-21chrt22:17:423
1991099483,31cyclictest14510-21taskset22:32:583
1991099482,33cyclictest11061-21taskset00:10:233
1991099473,34cyclictest24514-21chrt21:00:223
1991099473,34cyclictest24514-21chrt21:00:223
1991099473,32cyclictest5769-21chrt00:02:413
1991099473,32cyclictest30380-21chrt19:40:063
1991099472,35cyclictest25583-21chrt23:42:113
1991099472,35cyclictest23107-21chrt23:38:553
1991099472,35cyclictest23107-21chrt23:38:553
1991099472,34cyclictest28639-21chrt19:35:043
1991099463,32cyclictest11672-21chrt21:36:003
1991099463,29cyclictest5771-21chrt20:04:493
1991099463,28cyclictest17474-21chrt20:40:043
1991099462,32cyclictest21360-21chrt21:51:123
1991099462,32cyclictest21360-21chrt21:51:123
1991099462,31cyclictest633-21taskset22:10:213
19910994611,26cyclictest0-21swapper/320:05:073
19910994533,8cyclictest451rcuc/319:23:023
1991099453,29cyclictest9924-21chrt23:16:593
1991099443,27cyclictest14680-21chrt20:30:163
19910994431,9cyclictest451rcuc/320:14:303
1991099442,34cyclictest12847-21chrt20:25:103
1991099433,28cyclictest26997-21chrt21:09:493
19910994230,8cyclictest451rcuc/319:30:183
19910994230,8cyclictest451rcuc/319:30:183
1991099403,23cyclictest32339-21chrt19:45:133
1991099392,26cyclictest12019-21taskset20:21:093
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional