You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-10 - 07:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7.osadl.org (updated Sun May 10, 2026 00:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
364021349,86sleep23691-21fschecks_count18:57:372
4882991233,9cyclictest0-21swapper/020:16:450
4882991233,63cyclictest22469-21ssh00:01:430
4882991233,63cyclictest22469-21ssh00:01:430
4882991153,27cyclictest15460-21/usr/sbin/munin21:06:530
4882991143,43cyclictest4319-21ssh23:31:430
4882991143,43cyclictest4319-21ssh23:31:430
4882991143,26cyclictest21294-21sh23:05:470
4882991143,26cyclictest21294-21sh23:05:470
4882991142,28cyclictest23669-21ssh22:14:430
4882991142,26cyclictest12735-21munin-node21:56:400
4882991142,26cyclictest12735-21munin-node21:56:400
4882991134,25cyclictest11950-21/usr/sbin/munin19:21:480
4882991133,28cyclictest6452-21taskset19:06:310
4882991133,24cyclictest32467-21ssh21:35:440
4882991133,24cyclictest32467-21ssh21:35:440
4882991133,23cyclictest5793-21ssh21:45:150
4882991132,25cyclictest20089-21sh21:14:270
4882991132,24cyclictest800-21taskset00:19:330
4882991132,24cyclictest800-21taskset00:19:330
4882991123,25cyclictest12573-21ssh22:51:200
4882991123,21cyclictest1189-21/usr/sbin/munin22:31:450
4882991122,28cyclictest7950-21grep23:37:010
4882991122,28cyclictest19545-21wc22:07:060
4882991113,26cyclictest3747-21sh00:23:530
4882991113,26cyclictest24093-21/usr/sbin/munin21:22:060
4882991113,25cyclictest13556-21/usr/sbin/munin19:26:570
4882991113,24cyclictest31828-21rm22:27:380
4882991112,25cyclictest24941-21taskset20:01:420
4882991105,70cyclictest0-21swapper/023:06:460
4882991104,24cyclictest11351-21/usr/sbin/munin19:17:080
4882991103,35cyclictest16135-21ssh22:01:550
4882991103,28cyclictest18407-21acpi19:41:390
4882991103,28cyclictest18407-21acpi19:41:390
4882991103,27cyclictest21585-21sed21:16:530
48829911026,54cyclictest0-21swapper/023:56:290
4882991102,26cyclictest12055-21ssh23:44:080
3430211011,68sleep13414-21apt-get18:56:511
4882991098,25cyclictest29672-21seq00:12:410
4882991093,70cyclictest27103-21ssh21:26:420
4882991093,32cyclictest21485-21runrttasks19:51:310
48829910926,59cyclictest0-21swapper/021:47:420
4882991092,26cyclictest7645-21ntp_states19:07:010
4882991092,20cyclictest4029-21ssh22:36:390
4882991083,27cyclictest31558-21runrttasks20:21:490
4882991083,26cyclictest27218-21ssh23:15:400
4882991083,26cyclictest18580-21ssh23:01:280
4882991082,47cyclictest8884-21apt-get20:51:590
4882991082,28cyclictest29300-21ssh23:18:090
4882991082,28cyclictest28192-21taskset20:11:430
4882991082,25cyclictest6183-21rm00:27:250
4882991082,25cyclictest25954-21rm22:17:470
4882991082,25cyclictest21767-21ssh00:00:280
48829910812,61cyclictest11554-21seq20:57:540
48829910812,61cyclictest11554-21seq20:57:540
48869910788,9cyclictest0-21swapper/119:46:291
48869910788,9cyclictest0-21swapper/119:46:291
4882991073,26cyclictest14221-21ssh21:04:490
4882991072,25cyclictest11176-21ssh21:52:560
4882991064,27cyclictest5520-21kworker/u17:0+ext4-rsv-conversion22:41:480
4882991064,25cyclictest1907-21rm21:37:400
4882991063,26cyclictest14963-21ssh22:54:350
4882991063,25cyclictest26745-21ssh00:07:500
4882991063,25cyclictest26745-21ssh00:07:500
4882991062,24cyclictest312-21ssh23:24:390
4882991062,24cyclictest312-21ssh23:24:390
4882991052,27cyclictest15087-21ssh23:49:150
4882991052,26cyclictest1267-21ssh23:26:360
4882991042,26cyclictest29449-21sh22:24:190
4882991042,26cyclictest29449-21sh22:24:190
4882991033,22cyclictest8757-21taskset19:11:410
4882991032,8cyclictest0-21swapper/019:51:440
4882991032,25cyclictest17834-21runrttasks19:37:300
4882991032,25cyclictest17834-21runrttasks19:37:300
4882991022,21cyclictest6449-21seq20:42:470
3749210111,60sleep03777-21basename18:57:390
48959910078,15cyclictest25804-21kernelversion00:06:542
48959910078,15cyclictest25804-21kernelversion00:06:542
48959910059,11cyclictest181rcu_preempt20:31:512
48959910059,11cyclictest181rcu_preempt20:31:512
4882991002,25cyclictest16209-21sshd19:32:130
4882991002,25cyclictest16209-21sshd19:32:130
4882991002,24cyclictest545-21apt-get20:26:400
488299993,27cyclictest4375-21processes20:37:030
488299992,24cyclictest23851-21ntp_offset19:56:570
4895999781,10cyclictest9173-21fschecks_time20:52:372
488699973,70cyclictest16799-21ssh23:52:341
488299972,20cyclictest2166-21/usr/sbin/munin20:31:580
488299972,20cyclictest2166-21/usr/sbin/munin20:31:580
4895999673,15cyclictest4873-21cyclictest19:11:322
4886999532,25cyclictest0-21swapper/122:22:031
4886999532,25cyclictest0-21swapper/122:22:031
488299954,24cyclictest8059-21runrttasks20:47:500
4895999462,8cyclictest181rcu_preempt22:02:042
4886999472,15cyclictest26184-21sh00:07:041
4886999472,15cyclictest26184-21sh00:07:041
4886999441,28cyclictest4873-21cyclictest21:14:481
4895999359,13cyclictest181rcu_preempt23:36:202
4895999359,13cyclictest181rcu_preempt23:36:202
488299933,26cyclictest26531-21/usr/sbin/munin20:06:400
4895999264,14cyclictest0-21swapper/223:57:342
4895999226,25cyclictest0-21swapper/223:37:072
489599913,70cyclictest15884-21apt-get23:51:442
4895999055,16cyclictest181rcu_preempt22:47:042
4886999051,9cyclictest181rcu_preempt23:01:531
4886999051,9cyclictest181rcu_preempt23:01:531
4895998972,11cyclictest9198-21kworker/u17:2-xprtiod21:32:062
4895998972,11cyclictest9198-21kworker/u17:2-xprtiod21:32:062
4895998965,18cyclictest21329-21sendmail22:11:282
4895998955,12cyclictest181rcu_preempt21:47:162
4886998971,12cyclictest3778-21ssh22:36:311
4886998964,15cyclictest0-21swapper/121:56:461
4886998964,15cyclictest0-21swapper/121:56:461
4895998866,12cyclictest0-21swapper/222:27:012
4895998862,8cyclictest181rcu_preempt19:21:512
4886998861,19cyclictest7041-21cpu22:41:431
4895998750,18cyclictest181rcu_preempt00:23:072
4895998747,18cyclictest11857-21diskmemload21:44:432
4895998661,14cyclictest0-21swapper/219:11:522
4886998669,9cyclictest0-21swapper/121:01:561
4886998662,8cyclictest181rcu_preempt19:51:581
4886998647,8cyclictest181rcu_preempt23:37:041
4895998562,12cyclictest0-21swapper/222:56:512
4895998549,27cyclictest25685-21grep22:17:062
4886998563,12cyclictest0-21swapper/121:41:321
4886998542,34cyclictest31207-21ssh23:21:551
4886998542,34cyclictest31207-21ssh23:21:551
488699852,47cyclictest4698-21diskmemload22:37:021
4895998464,11cyclictest0-21swapper/220:06:322
4895998464,10cyclictest0-21swapper/221:08:362
4895998460,15cyclictest0-21swapper/221:16:492
4895998429,17cyclictest181rcu_preempt20:11:322
4886998469,9cyclictest0-21swapper/121:26:311
4886998463,15cyclictest30444-21idleruntime21:31:541
4886998463,15cyclictest30444-21idleruntime21:31:541
4886998454,8cyclictest181rcu_preempt20:21:531
4886998433,14cyclictest181rcu_preempt23:10:261
4895998363,6cyclictest181rcu_preempt20:57:012
4895998363,6cyclictest181rcu_preempt20:57:012
4895998360,8cyclictest181rcu_preempt21:21:592
4895998349,10cyclictest181rcu_preempt20:27:012
4886998361,16cyclictest544-21cron22:31:281
4886998361,16cyclictest24300-21latency_hist22:16:331
4886998360,18cyclictest7315-21sh21:47:411
4886998336,20cyclictest0-21swapper/119:26:321
4895998260,7cyclictest181rcu_preempt22:31:562
4895998258,15cyclictest0-21swapper/222:41:492
4895998258,13cyclictest0-21swapper/219:27:022
4895998225,9cyclictest0-21swapper/223:44:062
488699827,57cyclictest8355-21apt-get20:51:491
4886998256,17cyclictest3836-21cut21:41:491
4886998248,20cyclictest181rcu_preempt23:50:221
4895998163,10cyclictest0-21swapper/220:16:552
4895998160,11cyclictest0-21swapper/221:57:392
4895998160,11cyclictest0-21swapper/221:57:392
4895998150,12cyclictest181rcu_preempt23:27:542
4886998163,9cyclictest0-21swapper/120:06:551
4886998135,23cyclictest0-21swapper/119:06:381
4886998131,13cyclictest181rcu_preempt23:59:311
4895998062,12cyclictest5176-21ssh00:26:492
4895998037,7cyclictest181rcu_preempt19:02:122
4895998037,22cyclictest0-21swapper/221:36:502
4895998035,9cyclictest181rcu_preempt20:41:522
4886998053,10cyclictest181rcu_preempt21:28:181
4886998049,11cyclictest181rcu_preempt21:18:091
4886998044,13cyclictest181rcu_preempt20:42:051
4886998034,17cyclictest181rcu_preempt00:28:431
4886998028,33cyclictest4873-21cyclictest23:26:351
488699802,32cyclictest1481-21apt-get00:21:281
488699802,32cyclictest1481-21apt-get00:21:281
4895997955,16cyclictest19676-21snmpd21:29:192
4895997945,11cyclictest181rcu_preempt20:13:392
4895997940,16cyclictest181rcu_preempt23:12:572
4895997931,9cyclictest0-21swapper/223:20:022
4895997930,13cyclictest181rcu_preempt20:36:522
4886997964,10cyclictest16824-21timerandwakeup22:57:051
4886997945,11cyclictest181rcu_preempt19:56:521
4886997944,11cyclictest181rcu_preempt20:16:521
4886997943,16cyclictest181rcu_preempt23:16:571
4886997938,10cyclictest181rcu_preempt22:55:351
4886997937,12cyclictest181rcu_preempt00:11:401
4886997932,13cyclictest181rcu_preempt20:37:061
4886997924,13cyclictest181rcu_preempt22:17:481
4895997864,10cyclictest4873-21cyclictest20:22:042
4895997860,8cyclictest0-21swapper/219:31:462
4895997860,8cyclictest0-21swapper/219:31:462
4895997856,9cyclictest181rcu_preempt22:11:382
4895997856,12cyclictest0-21swapper/223:06:462
4895997848,8cyclictest181rcu_preempt21:06:182
4895997841,18cyclictest12977-21ssh22:51:392
4895997840,13cyclictest181rcu_preempt00:16:532
4895997840,13cyclictest181rcu_preempt00:16:532
4886997857,14cyclictest4873-21cyclictest19:04:381
4886997851,8cyclictest181rcu_preempt19:32:001
4886997851,8cyclictest181rcu_preempt19:32:001
4886997849,8cyclictest181rcu_preempt21:51:591
4886997846,9cyclictest181rcu_preempt22:50:041
4886997841,9cyclictest181rcu_preempt23:31:371
4886997841,9cyclictest181rcu_preempt23:31:371
4895997755,16cyclictest352-21runrttasks19:41:392
4895997755,16cyclictest352-21runrttasks19:41:392
4895997749,9cyclictest181rcu_preempt00:13:462
4895997744,12cyclictest181rcu_preempt19:37:042
4895997744,12cyclictest181rcu_preempt19:37:042
4895997739,11cyclictest181rcu_preempt19:52:022
4886997758,13cyclictest297-21systemd-logind23:16:301
4886997756,11cyclictest0-21swapper/119:11:511
4886997737,13cyclictest181rcu_preempt20:11:581
4895997638,16cyclictest181rcu_preempt22:41:322
4895997629,25cyclictest0-21swapper/200:01:522
4895997629,25cyclictest0-21swapper/200:01:522
4886997658,13cyclictest352-21runrttasks22:06:401
4886997655,13cyclictest0-21swapper/123:41:491
4886997641,9cyclictest181rcu_preempt21:11:321
4886997641,10cyclictest181rcu_preempt19:16:591
4886997634,9cyclictest181rcu_preempt20:27:081
4886997634,16cyclictest181rcu_preempt19:39:081
4886997634,16cyclictest181rcu_preempt19:39:081
4895997557,13cyclictest20857-21sh21:16:312
4895997556,9cyclictest0-21swapper/223:26:312
4895997556,9cyclictest0-21swapper/223:26:312
4895997550,10cyclictest181rcu_preempt22:23:132
4895997550,10cyclictest181rcu_preempt22:23:132
4895997541,11cyclictest181rcu_preempt23:06:322
4895997541,11cyclictest181rcu_preempt23:06:322
4886997554,8cyclictest181rcu_preempt19:26:541
4886997535,10cyclictest181rcu_preempt00:24:251
4886997533,19cyclictest0-21swapper/120:31:561
4886997533,19cyclictest0-21swapper/120:31:561
4895997443,8cyclictest181rcu_preempt19:57:052
4895997439,10cyclictest181rcu_preempt23:50:302
4886997446,8cyclictest181rcu_preempt00:05:301
4886997446,8cyclictest181rcu_preempt00:05:301
4886997426,19cyclictest0-21swapper/119:49:371
4886997419,9cyclictest0-21swapper/122:06:121
4895997337,8cyclictest181rcu_preempt19:16:582
4886997339,13cyclictest181rcu_preempt20:47:071
488699732,45cyclictest11304-21cat20:57:051
488699732,45cyclictest11304-21cat20:57:051
4895997247,8cyclictest181rcu_preempt21:53:142
4895997243,13cyclictest181rcu_preempt20:46:542
4895997049,16cyclictest21020-21unixbench_singl19:47:072
4886997024,12cyclictest181rcu_preempt20:01:391
490399693,33cyclictest8887-21chrt20:51:413
109852640,7sleep30-21swapper/323:42:013
490399614,47cyclictest16489-21chrt23:51:423
490399606,40cyclictest18872-21chrt23:01:373
490399606,40cyclictest18872-21chrt23:01:373
490399606,39cyclictest8211-21taskset19:08:293
490399604,40cyclictest581-21taskset21:36:393
490399603,39cyclictest17954-21chrt22:05:213
490399582,43cyclictest23284-21taskset19:56:333
490399573,41cyclictest25219-21taskset00:06:323
490399573,41cyclictest25219-21taskset00:06:323
490399573,37cyclictest12068-21taskset19:21:463
490399564,36cyclictest11874-21chrt21:01:293
490399564,36cyclictest11874-21chrt21:01:293
490399563,41cyclictest19571-21taskset23:56:513
490399562,39cyclictest6863-21chrt21:46:533
490399553,39cyclictest29057-21taskset21:29:343
490399553,36cyclictest18690-21chrt22:06:433
490399544,35cyclictest15384-21chrt19:31:503
490399544,35cyclictest15384-21chrt19:31:503
490399544,34cyclictest16297-21taskset23:51:343
490399543,39cyclictest12565-21taskset21:01:543
490399543,38cyclictest32307-21chrt23:23:173
490399543,38cyclictest32307-21chrt23:23:173
490399533,39cyclictest23416-21chrt21:20:263
490399533,38cyclictest15970-21taskset22:56:423
490399533,36cyclictest22241-21taskset22:11:583
416325312,23sleep30-21swapper/318:57:553
490399524,36cyclictest3796-21taskset22:36:313
4903995235,10cyclictest88332sleep320:51:333
490399523,38cyclictest17634-21taskset19:37:053
490399523,38cyclictest17634-21taskset19:37:053
490399523,36cyclictest29595-21taskset23:19:003
490399522,37cyclictest23990-21taskset23:10:003
490399522,36cyclictest30703-21chrt22:26:463
285842524,9sleep30-21swapper/300:11:523
490399514,34cyclictest5375-21chrt19:01:573
490399513,34cyclictest3557-21chrt20:36:303
490399513,34cyclictest3557-21chrt20:36:303
490399513,34cyclictest10194-21chrt21:51:553
490399512,39cyclictest8791-21taskset22:44:013
490399512,36cyclictest4666-21taskset22:37:003
490399512,35cyclictest16645-21chrt21:08:143
490399503,37cyclictest5041-21chrt23:32:013
490399503,37cyclictest5041-21chrt23:32:013
490399503,37cyclictest31285-21chrt21:32:223
490399503,37cyclictest31285-21chrt21:32:223
490399503,36cyclictest19993-21chrt19:46:323
490399503,35cyclictest20871-21chrt19:47:053
490399503,35cyclictest11654-21chrt22:48:433
490399503,34cyclictest14481-21chrt21:58:533
490399503,34cyclictest14481-21chrt21:58:533
490399502,38cyclictest28033-21chrt20:11:313
490399502,34cyclictest25511-21chrt23:12:023
490399494,34cyclictest1689-21chrt00:21:323
490399494,34cyclictest1689-21chrt00:21:323
490399493,36cyclictest6345-21chrt00:27:523
490399493,34cyclictest27035-21chrt00:08:393
490399493,34cyclictest27035-21chrt00:08:393
490399492,37cyclictest14959-21chrt22:54:353
490399492,35cyclictest1083-21taskset20:26:593
490399492,34cyclictest5978-21chrt21:45:473
490399492,32cyclictest10165-21chrt19:16:313
490399484,35cyclictest29735-21chrt22:25:083
490399484,35cyclictest29735-21chrt22:25:083
490399483,32cyclictest4738-21chrt00:26:313
490399483,32cyclictest24625-21chrt21:21:563
490399483,30cyclictest27346-21chrt22:21:313
490399482,35cyclictest28641-21chrt20:11:563
490399474,31cyclictest31686-21chrt20:21:523
490399473,34cyclictest7577-21chrt23:36:513
490399473,34cyclictest4414-21chrt20:37:033
490399463,29cyclictest20157-21chrt21:14:393
490399432,29cyclictest14112-21chrt19:27:003
490399432,27cyclictest25383-21chrt20:01:563
490399423,28cyclictest18644-21chrt19:41:513
490399422,28cyclictest1885-21taskset23:26:583
490399413,28cyclictest11728-21chrt19:21:293
490399404,27cyclictest24001-21taskset19:57:023
490399404,26cyclictest29850-21taskset20:16:463
490399392,27cyclictest5417-21chrt20:41:453
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional