You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-03 - 19:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot7.osadl.org (updated Mon Aug 03, 2026 12:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
321449910847,32cyclictest19676-21snmpd11:38:452
321449910766,34cyclictest15792-21ls09:10:432
321449910730,39cyclictest0-21swapper/211:26:132
321449910730,39cyclictest0-21swapper/211:26:132
321449910330,47cyclictest0-21swapper/207:16:422
32144991003,31cyclictest18868-21sh11:02:302
32144991003,31cyclictest18868-21sh11:02:302
3214499992,34cyclictest352-21runrttasks08:18:342
3214499992,34cyclictest352-21runrttasks08:18:342
3214499972,26cyclictest6289-21taskset08:52:152
3120629710,62sleep030631-21/usr/sbin/munin06:51:210
3120629710,62sleep030631-21/usr/sbin/munin06:51:210
32144999620,46cyclictest0-21swapper/209:25:432
3213799963,60cyclictest15-21ksoftirqd/007:50:520
3214499953,28cyclictest22081-21ssh11:08:002
32144999532,39cyclictest0-21swapper/208:50:232
32140999449,8cyclictest181rcu_preempt09:10:581
32140999449,8cyclictest181rcu_preempt09:10:581
3214499922,29cyclictest6580-21diskmemload10:58:342
32140999271,14cyclictest28995-21ssh09:31:521
32140999151,12cyclictest181rcu_preempt09:18:321
3214899909,53cyclictest0-21swapper/309:30:563
32144999063,11cyclictest181rcu_preempt10:16:112
3214499903,6cyclictest0-21swapper/209:50:512
32144999032,48cyclictest0-21swapper/207:32:252
32140999044,12cyclictest181rcu_preempt08:56:101
3214499899,34cyclictest29737-21grep12:15:432
3214499899,34cyclictest29737-21grep12:15:432
32140998962,21cyclictest1419-21latency_hist07:00:441
32144998838,43cyclictest0-21swapper/210:11:142
32144998838,43cyclictest0-21swapper/210:11:142
32144998838,41cyclictest0-21swapper/210:51:032
32144998838,41cyclictest0-21swapper/210:51:032
3214499882,34cyclictest3579-21latency_hist08:45:442
32137998826,26cyclictest15-21ksoftirqd/007:06:500
3214499874,8cyclictest0-21swapper/209:45:532
3214499874,8cyclictest0-21swapper/209:45:532
32144998742,37cyclictest0-21swapper/210:05:402
3214499872,27cyclictest352-21runrttasks10:07:212
32140998741,12cyclictest181rcu_preempt11:55:211
3214499863,6cyclictest0-21swapper/207:45:562
3214499863,30cyclictest352-21runrttasks08:02:262
3214499862,29cyclictest25685-21mailstats09:26:142
32140998663,13cyclictest0-21swapper/110:06:051
32137998658,20cyclictest23674-21fschecks_time11:11:030
3213799863,53cyclictest15-21ksoftirqd/011:50:430
3214499854,7cyclictest0-21swapper/211:20:532
3214499853,7cyclictest0-21swapper/211:50:532
3214499853,40cyclictest352-21runrttasks09:35:412
3214499853,38cyclictest583-21/usr/sbin/munin12:21:002
3214499853,30cyclictest28160-21grep08:21:002
3214499853,30cyclictest28160-21grep08:21:002
32140998560,16cyclictest17769-21kworker/u17:3-rpciod08:10:411
32140998560,16cyclictest17769-21kworker/u17:3-rpciod08:10:411
32140998557,20cyclictest27894-21latency_hist08:20:431
32140998557,20cyclictest27894-21latency_hist08:20:431
32140998532,11cyclictest181rcu_preempt11:21:171
32137998528,7cyclictest181rcu_preempt10:05:420
32137998520,41cyclictest15-21ksoftirqd/007:03:140
3214499844,7cyclictest0-21swapper/212:15:562
3214499844,7cyclictest0-21swapper/212:15:562
3214499843,35cyclictest352-21runrttasks11:10:592
3214499843,33cyclictest668-21ssh10:31:572
3214499843,28cyclictest18952-21/usr/sbin/munin11:56:182
3214499843,25cyclictest352-21runrttasks09:05:132
3214499842,6cyclictest0-21swapper/210:35:562
3214499842,39cyclictest352-21runrttasks10:21:002
32140998463,15cyclictest29410-21latency_hist08:25:421
32140998463,15cyclictest29410-21latency_hist08:25:421
32140998461,13cyclictest0-21swapper/109:45:431
32140998433,12cyclictest181rcu_preempt09:50:571
3213799844,44cyclictest15-21ksoftirqd/009:14:000
3213799844,44cyclictest15-21ksoftirqd/009:14:000
3128328418,37sleep20-21swapper/206:51:232
3128328418,37sleep20-21swapper/206:51:232
32144998365,12cyclictest6580-21diskmemload11:31:052
3214499834,71cyclictest529-21ssh09:38:172
3214499834,71cyclictest529-21ssh09:38:172
3214499833,40cyclictest12000-21apt-get11:45:522
3214499833,38cyclictest10776-21dpkg09:55:522
3214499832,32cyclictest5362-21grep07:11:042
3214499832,26cyclictest31194-21/usr/sbin/munin08:30:592
32140998361,12cyclictest0-21swapper/107:06:171
32140998360,13cyclictest0-21swapper/111:00:431
32140998356,11cyclictest181rcu_preempt11:06:181
32140998351,9cyclictest181rcu_preempt09:01:031
32140998347,12cyclictest181rcu_preempt09:30:191
32140998345,12cyclictest181rcu_preempt10:12:141
32140998345,12cyclictest181rcu_preempt10:12:141
32140998343,12cyclictest181rcu_preempt11:57:411
32140998334,16cyclictest181rcu_preempt07:29:411
32140998323,22cyclictest0-21swapper/112:21:151
32137998343,18cyclictest0-21swapper/008:21:590
32137998343,18cyclictest0-21swapper/008:21:590
32137998330,12cyclictest181rcu_preempt11:43:020
3214499825,66cyclictest0-21swapper/207:35:542
3214499825,66cyclictest0-21swapper/207:35:542
32144998240,35cyclictest0-21swapper/207:06:182
3214499822,32cyclictest26594-21awk12:10:402
32140998259,13cyclictest0-21swapper/108:05:441
32140998255,17cyclictest352-21runrttasks11:01:041
32140998255,17cyclictest352-21runrttasks11:01:041
32140998250,8cyclictest181rcu_preempt11:31:041
32140998240,13cyclictest181rcu_preempt10:36:471
3213799826,48cyclictest15-21ksoftirqd/011:23:290
32137998261,15cyclictest15816-21latency_hist09:10:440
32137998255,18cyclictest6580-21diskmemload11:07:550
3214499815,70cyclictest0-21swapper/209:40:542
3214499814,7cyclictest0-21swapper/206:55:522
3214499814,7cyclictest0-21swapper/206:55:522
3214499813,8cyclictest0-21swapper/208:10:522
3214499813,8cyclictest0-21swapper/208:10:522
3214499813,37cyclictest29502-21/usr/sbin/munin10:26:142
3214499813,37cyclictest2863-21grep07:01:202
3214499812,34cyclictest9688-21sh10:46:572
3214499812,32cyclictest23224-21taskset08:06:432
3214499812,32cyclictest23224-21taskset08:06:432
3214499812,31cyclictest18535-21/usr/sbin/munin07:51:092
3214499812,30cyclictest7305-21/usr/sbin/munin08:56:062
3214499812,30cyclictest27213-21timerandwakeup11:16:152
3214499812,30cyclictest27213-21timerandwakeup11:16:152
32140998157,16cyclictest31554-21latency_hist10:30:431
32140998157,14cyclictest0-21swapper/112:06:021
32140998156,13cyclictest0-21swapper/108:35:441
32140998142,9cyclictest181rcu_preempt07:36:091
32140998142,9cyclictest181rcu_preempt07:36:091
32140998142,18cyclictest181rcu_preempt09:06:021
3213799813,48cyclictest15-21ksoftirqd/010:00:440
32137998115,26cyclictest15-21ksoftirqd/012:10:580
32137998115,26cyclictest15-21ksoftirqd/012:10:580
3214499803,41cyclictest8350-21apt-get07:20:532
3214499803,31cyclictest15951-21sh09:10:552
3214499803,31cyclictest15951-21sh09:10:552
3214499803,30cyclictest1217-21/usr/sbin/munin08:36:152
3214499802,39cyclictest11668-21apt11:45:402
3214499802,30cyclictest5915-21/usr/sbin/munin10:41:102
32140998057,12cyclictest0-21swapper/108:15:431
32140998057,12cyclictest0-21swapper/108:15:431
32140998047,10cyclictest181rcu_preempt10:51:051
32140998047,10cyclictest181rcu_preempt10:51:051
32140998037,16cyclictest181rcu_preempt07:00:511
32140998028,16cyclictest181rcu_preempt12:13:301
32140998028,16cyclictest181rcu_preempt12:13:301
32140998025,21cyclictest0-21swapper/111:16:001
32140998025,21cyclictest0-21swapper/111:16:001
32137998035,8cyclictest181rcu_preempt10:35:570
3213799803,38cyclictest15-21ksoftirqd/011:53:530
32137998032,12cyclictest181rcu_preempt07:26:060
32137998020,32cyclictest15-21ksoftirqd/008:26:010
32144997938,34cyclictest0-21swapper/209:15:512
3214499793,31cyclictest20939-21ssh12:00:542
3214499793,30cyclictest15138-21/usr/sbin/munin07:41:092
3214499793,29cyclictest19876-21fschecks_count07:56:022
3214499792,31cyclictest11179-21seq07:28:582
32140997957,16cyclictest32128-21cyclictest09:55:581
32140997952,20cyclictest5892-21threads07:11:171
32140997944,11cyclictest181rcu_preempt08:37:421
32140997930,12cyclictest181rcu_preempt11:40:591
32137997952,7cyclictest181rcu_preempt11:29:300
32137997952,7cyclictest181rcu_preempt11:29:300
32137997937,8cyclictest181rcu_preempt10:19:450
3213799793,36cyclictest6105-21apt-get11:35:520
32137997933,12cyclictest181rcu_preempt10:24:350
3214899784,28cyclictest23045-21chrt11:10:403
3214899782,33cyclictest27237-21taskset12:11:043
3214899782,33cyclictest27237-21taskset12:11:043
3214499783,27cyclictest29586-21/usr/sbin/munin08:25:512
32140997850,8cyclictest181rcu_preempt11:50:421
32140997838,8cyclictest181rcu_preempt08:46:101
32140997838,13cyclictest181rcu_preempt07:45:591
32140997827,13cyclictest181rcu_preempt07:35:431
32137997847,9cyclictest181rcu_preempt10:09:120
3213799783,40cyclictest31096-21ssh10:29:410
3213799782,40cyclictest15-21ksoftirqd/012:16:580
3213799782,40cyclictest15-21ksoftirqd/012:16:580
32137997823,28cyclictest15-21ksoftirqd/008:37:150
314462789,38sleep10-21swapper/106:51:261
314462789,38sleep10-21swapper/106:51:261
32140997750,7cyclictest181rcu_preempt12:16:471
32140997750,7cyclictest181rcu_preempt12:16:471
32140997741,7cyclictest181rcu_preempt10:16:101
32140997727,22cyclictest0-21swapper/108:26:021
32140997727,20cyclictest0-21swapper/111:11:081
3214099772,41cyclictest31-21ksoftirqd/107:16:181
32137997757,7cyclictest181rcu_preempt09:16:310
32137997717,34cyclictest15-21ksoftirqd/009:36:020
32137997717,34cyclictest15-21ksoftirqd/009:36:020
32137997711,39cyclictest15-21ksoftirqd/010:30:510
32140997652,16cyclictest32128-21cyclictest10:21:131
32140997646,8cyclictest181rcu_preempt11:36:551
32140997638,8cyclictest181rcu_preempt07:56:171
32140997628,13cyclictest181rcu_preempt09:22:411
32137997655,13cyclictest31475-21fschecks_time08:31:050
3213799764,39cyclictest15-21ksoftirqd/011:18:330
3213799764,39cyclictest15-21ksoftirqd/011:18:330
32137997630,16cyclictest181rcu_preempt10:49:240
32137997622,24cyclictest15-21ksoftirqd/012:02:130
3214899753,35cyclictest2506-21chrt09:41:163
3214899753,30cyclictest32316-21chrt11:25:473
3214899753,30cyclictest32316-21chrt11:25:473
32140997542,9cyclictest181rcu_preempt07:21:141
32140997537,11cyclictest181rcu_preempt06:56:121
32140997534,8cyclictest181rcu_preempt08:40:511
32140997527,12cyclictest181rcu_preempt12:04:241
3213799755,38cyclictest15-21ksoftirqd/009:27:310
32137997548,18cyclictest13468-21fschecks_time07:36:040
32137997548,18cyclictest13468-21fschecks_time07:36:040
3213799753,39cyclictest15-21ksoftirqd/008:51:110
32137997527,15cyclictest181rcu_preempt11:00:030
32140997439,8cyclictest181rcu_preempt10:46:191
32140997437,8cyclictest181rcu_preempt07:41:171
32140997433,16cyclictest181rcu_preempt10:41:041
32140997431,7cyclictest181rcu_preempt09:50:441
32140997431,7cyclictest181rcu_preempt09:50:441
32140997430,16cyclictest181rcu_preempt10:04:381
32140997430,13cyclictest181rcu_preempt09:36:151
32140997430,13cyclictest181rcu_preempt09:36:151
3213799746,38cyclictest15-21ksoftirqd/007:31:090
3213799745,38cyclictest15-21ksoftirqd/010:50:580
3213799745,38cyclictest15-21ksoftirqd/010:50:580
32137997450,18cyclictest18083-21cstates11:55:580
32137997429,18cyclictest181rcu_preempt12:23:560
3213799742,46cyclictest15-21ksoftirqd/007:15:440
32137997423,8cyclictest0-21swapper/011:33:140
3213799742,36cyclictest15-21ksoftirqd/008:57:270
3213799742,36cyclictest15-21ksoftirqd/008:40:510
32140997319,27cyclictest0-21swapper/111:26:161
32140997319,27cyclictest0-21swapper/111:26:161
32137997356,8cyclictest0-21swapper/007:56:020
32137997356,11cyclictest297-21systemd-logind07:00:410
32137997356,11cyclictest297-21systemd-logind07:00:410
32137997355,9cyclictest0-21swapper/009:01:160
32137997351,15cyclictest4763-21cpu09:45:560
32137997351,15cyclictest4763-21cpu09:45:560
32137997335,10cyclictest181rcu_preempt09:23:240
3213799732,46cyclictest15-21ksoftirqd/008:14:380
3213799732,46cyclictest15-21ksoftirqd/008:14:380
32137997322,30cyclictest181rcu_preempt09:30:500
32140997249,14cyclictest19179-21kworker/u17:2-rpciod10:31:051
3213799724,32cyclictest16925-21ntp_kernel_err07:46:110
32137997241,7cyclictest181rcu_preempt09:51:560
32137997236,7cyclictest181rcu_preempt10:40:530
32137997212,25cyclictest15-21ksoftirqd/009:41:100
3114027221,28sleep30-21swapper/306:51:163
3114027221,28sleep30-21swapper/306:51:163
3214899713,33cyclictest23996-21chrt11:11:123
32140997141,13cyclictest181rcu_preempt08:51:171
32137997111,35cyclictest15-21ksoftirqd/008:05:570
32137997111,35cyclictest15-21ksoftirqd/008:05:570
3214899704,37cyclictest0-21swapper/311:36:143
32140997026,21cyclictest0-21swapper/107:51:161
3213799705,38cyclictest15-21ksoftirqd/007:40:590
32137997052,9cyclictest0-21swapper/008:01:130
32137997052,11cyclictest20011-21cron11:05:400
32137997052,11cyclictest20011-21cron11:05:400
32137997035,12cyclictest181rcu_preempt07:21:050
3214899695,39cyclictest231772sleep308:06:073
3214899695,39cyclictest231772sleep308:06:073
32137996935,7cyclictest181rcu_preempt10:10:570
32137996935,7cyclictest181rcu_preempt10:10:570
32137996932,9cyclictest181rcu_preempt07:16:120
32137996845,15cyclictest26568-21fschecks_count08:16:030
32137996845,15cyclictest26568-21fschecks_count08:16:030
32137996832,12cyclictest181rcu_preempt12:08:490
32137996513,24cyclictest15-21ksoftirqd/008:49:460
39882630,17sleep3451rcuc/311:31:193
3214899603,42cyclictest5180-21taskset07:10:583
3214899593,40cyclictest6782-21taskset08:55:443
3214899584,39cyclictest30999-21chrt11:22:523
3214899584,37cyclictest10262-21taskset09:01:033
3214899582,42cyclictest32464-21taskset06:56:003
3214899582,42cyclictest32464-21taskset06:56:003
3214899574,38cyclictest11366-21taskset11:44:533
3214899574,35cyclictest21770-21chrt08:01:093
3214899573,38cyclictest24761-21chrt09:25:433
3214899563,37cyclictest26241-21chrt08:15:433
3214899563,37cyclictest26241-21chrt08:15:433
3214899563,37cyclictest14179-21chrt10:01:053
3214899563,34cyclictest12419-21chrt10:51:193
3214899563,34cyclictest12419-21chrt10:51:193
3214899562,38cyclictest7205-21taskset10:43:283
3214899553,39cyclictest16128-21taskset10:58:113
3214899553,36cyclictest19429-21chrt07:55:423
3214899553,35cyclictest24331-21chrt12:06:053
3214899552,39cyclictest28902-21taskset10:25:583
3214899543,37cyclictest9679-21chrt07:25:413
3214899543,35cyclictest2608-21taskset10:36:033
3214899543,34cyclictest19154-21chrt09:16:033
3214899543,34cyclictest12611-21chrt11:46:103
3214899533,36cyclictest19379-21chrt11:03:553
3214899533,36cyclictest19379-21chrt11:03:553
3214899533,36cyclictest13433-21chrt09:06:063
3214899532,36cyclictest29755-21chrt08:26:003
3214899532,35cyclictest5490-21chrt09:46:143
3214899532,35cyclictest5490-21chrt09:46:143
3214899532,34cyclictest25993-21chrt10:21:033
3214899532,33cyclictest978-21taskset08:36:123
3214899523,36cyclictest22708-21chrt10:15:443
3214899523,35cyclictest31234-21chrt09:35:573
3214899523,35cyclictest31234-21chrt09:35:573
3214899523,35cyclictest25407-21chrt10:20:353
3214899523,32cyclictest9955-21chrt07:25:453
3214899522,36cyclictest31215-21chrt08:30:543
3214899522,35cyclictest21025-21chrt12:00:583
3214899522,34cyclictest16924-21chrt11:53:403
3214899513,35cyclictest2686-21chrt08:41:153
3214899512,37cyclictest2431-21taskset07:01:143
3214899512,34cyclictest19359-21chrt10:10:253
3214899512,32cyclictest8619-21chrt10:46:043
3214899504,34cyclictest27262-21taskset11:16:153
3214899504,34cyclictest27262-21taskset11:16:153
3214899502,32cyclictest14870-21taskset07:41:003
3214899493,36cyclictest16296-21chrt09:11:043
3214899493,36cyclictest16296-21chrt09:11:043
3214899493,35cyclictest10745-21chrt09:55:513
3214899493,34cyclictest26448-21chrt09:27:263
3214899492,35cyclictest484-21taskset12:20:573
3214899483,34cyclictest694-21chrt10:32:023
3214899483,34cyclictest11847-21taskset07:31:033
3214899482,33cyclictest18477-21chrt11:56:083
3214899474,31cyclictest9360-21taskset09:52:383
3214899474,31cyclictest31438-21chrt12:17:373
3214899474,31cyclictest31438-21chrt12:17:373
3214899473,34cyclictest3681-21chrt07:06:003
3214899472,29cyclictest21206-21chrt08:00:443
3214899464,31cyclictest29510-21chrt08:25:433
3214899464,31cyclictest29510-21chrt08:25:433
3214899464,30cyclictest26609-21chrt08:16:033
3214899464,30cyclictest26609-21chrt08:16:033
3214899463,31cyclictest17281-21chrt07:46:183
3214899463,26cyclictest22324-21chrt10:15:203
3214899453,31cyclictest8295-21chrt08:57:063
3214899433,28cyclictest13362-21chrt07:36:013
3214899433,28cyclictest13362-21chrt07:36:013
3214899424,29cyclictest4264-21taskset08:46:173
3214899412,26cyclictest7997-21chrt07:19:453
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional