You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-13 - 00:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Thu Mar 12, 2026 12:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1507421346,18sleep00-21swapper/007:04:490
15254991043,78cyclictest19940-21taskset08:55:443
152339910454,31cyclictest0-21swapper/009:05:440
152339910454,31cyclictest0-21swapper/009:05:440
15233991004,65cyclictest16598-21apt-get11:35:420
15247999777,8cyclictest0-21swapper/207:50:482
15247999676,10cyclictest0-21swapper/207:45:572
15247999676,10cyclictest0-21swapper/207:45:572
142992967,59sleep114330-21cat07:00:591
15247999576,9cyclictest0-21swapper/210:06:012
15233999433,33cyclictest15-21ksoftirqd/008:27:590
15247999372,12cyclictest0-21swapper/209:21:002
15247999274,9cyclictest0-21swapper/208:56:162
15247999175,8cyclictest0-21swapper/209:15:492
1511629115,51sleep215144-21munin-run07:05:242
1523399899,46cyclictest15-21ksoftirqd/008:15:520
15247998865,15cyclictest22669-21ssh11:45:402
1525499863,37cyclictest4221-21taskset10:20:553
15247998660,17cyclictest352-21runrttasks09:25:392
15239998665,11cyclictest0-21swapper/108:35:581
1523399862,60cyclictest1323-21apt-get11:10:510
15247998451,23cyclictest15518-21cpuspeed07:05:402
15247998451,23cyclictest15518-21cpuspeed07:05:402
15247998365,11cyclictest994-21ssh10:15:492
15233998362,15cyclictest4200-21sh10:20:550
15233998360,14cyclictest297-21systemd-logind08:10:240
15233998360,14cyclictest22475-21unixbench_singl09:00:580
15233998315,39cyclictest15-21ksoftirqd/008:01:300
15233998311,47cyclictest15-21ksoftirqd/009:22:040
1525499824,31cyclictest15838-21chrt07:05:493
1525499824,31cyclictest15838-21chrt07:05:493
1523399828,41cyclictest15-21ksoftirqd/008:53:020
15233998261,7cyclictest181rcu_preempt12:25:430
15233998261,7cyclictest181rcu_preempt12:25:430
1525499813,35cyclictest9244-21taskset10:30:233
1525499813,35cyclictest9244-21taskset10:30:233
15247998164,10cyclictest3100-21kworker/u18:1-events_unbound12:25:222
1523399817,34cyclictest15-21ksoftirqd/010:01:070
1523399813,41cyclictest15-21ksoftirqd/008:22:000
15233998125,30cyclictest15-21ksoftirqd/007:59:280
15233998120,33cyclictest15-21ksoftirqd/007:41:260
15233998120,33cyclictest15-21ksoftirqd/007:41:260
15233998116,32cyclictest211rcuc/010:50:500
15233998116,32cyclictest211rcuc/010:50:500
1525499805,56cyclictest0-21swapper/311:10:423
1525499803,37cyclictest25873-21taskset10:56:333
1525499803,34cyclictest22510-21taskset09:00:593
15239998010,32cyclictest352-21runrttasks11:29:571
15239998010,32cyclictest352-21runrttasks11:29:571
15233998048,25cyclictest0-21swapper/011:32:530
15233997961,12cyclictest22375-21systemd-run07:25:250
15233997957,17cyclictest603-21kworker/u19:0-ext4-rsv-conversion09:25:380
15233997938,12cyclictest12568-21users08:31:000
1523399793,57cyclictest22890-21diskmemload11:26:440
1523399793,57cyclictest22890-21diskmemload11:26:440
15239997858,9cyclictest0-21swapper/110:45:471
15233997856,15cyclictest11303-21ssh12:21:080
15233997855,8cyclictest181rcu_preempt11:05:240
15247997757,11cyclictest0-21swapper/211:25:592
15247997757,11cyclictest0-21swapper/211:25:592
1523999779,33cyclictest352-21runrttasks09:22:241
15239997715,23cyclictest23788-21seq10:54:111
15239997715,23cyclictest23788-21seq10:54:111
15239997711,30cyclictest352-21runrttasks12:31:471
15233997744,26cyclictest0-21swapper/009:48:010
15233997744,26cyclictest0-21swapper/009:48:010
1523399774,35cyclictest15-21ksoftirqd/007:27:530
15233997722,10cyclictest0-21swapper/009:34:430
15247997655,15cyclictest1-21systemd09:39:352
15247997651,16cyclictest1-21systemd08:55:242
15239997658,10cyclictest15223-21cyclictest11:13:341
15239997614,24cyclictest13901-21seq09:43:161
15239997612,26cyclictest4315-21seq08:06:331
15233997655,8cyclictest181rcu_preempt11:45:560
15233997655,15cyclictest297-21systemd-logind12:35:230
1523399764,37cyclictest15-21ksoftirqd/009:38:050
1523399763,33cyclictest15-21ksoftirqd/007:15:260
15233997612,39cyclictest15-21ksoftirqd/008:44:190
1525499753,21cyclictest20614-21chrt11:40:593
15247997554,10cyclictest0-21swapper/211:05:582
15247997552,16cyclictest15223-21cyclictest10:55:532
15247997521,18cyclictest27540-21sh11:00:322
15239997561,8cyclictest0-21swapper/109:30:231
15239997515,27cyclictest16633-21seq07:08:291
15239997515,27cyclictest16633-21seq07:08:291
15239997514,24cyclictest30347-21seq07:47:011
15239997514,24cyclictest30347-21seq07:47:011
15239997512,24cyclictest11951-21seq10:34:381
15233997551,8cyclictest181rcu_preempt12:07:050
15233997551,8cyclictest181rcu_preempt12:07:050
15233997529,25cyclictest15-21ksoftirqd/007:18:370
1523399752,39cyclictest27530-21latency_hist07:40:270
1525499744,26cyclictest32370-21chrt07:55:263
1525499743,34cyclictest2675-21chrt09:25:233
15247997459,9cyclictest58-21kcompactd007:26:492
15247997455,12cyclictest0-21swapper/212:25:592
15247997455,12cyclictest0-21swapper/212:25:592
15247997453,11cyclictest0-21swapper/207:35:442
1523999747,25cyclictest0-21swapper/111:04:491
15233997454,14cyclictest30889-21sshd07:50:360
15233997454,14cyclictest29717-21latency_hist10:10:250
1525499733,35cyclictest11797-21chrt12:21:373
1525499732,29cyclictest8729-21chrt09:35:253
15247997354,14cyclictest16033-21latency_hist11:35:262
15247997353,10cyclictest0-21swapper/208:45:442
15247997352,12cyclictest0-21swapper/207:21:202
15233997356,12cyclictest5116-21fschecks_time08:10:460
15233997352,8cyclictest181rcu_preempt11:07:400
15233997352,7cyclictest181rcu_preempt12:13:490
15233997347,12cyclictest181rcu_preempt11:55:450
15233997347,12cyclictest181rcu_preempt11:55:450
1523399733,24cyclictest22890-21diskmemload10:45:400
1523399732,27cyclictest18464-21latency_hist10:45:260
15233997311,36cyclictest15-21ksoftirqd/010:14:480
1525499724,29cyclictest3218-21chrt09:25:443
1525499722,31cyclictest18088-21chrt10:44:583
15247997253,9cyclictest0-21swapper/212:05:492
15247997253,9cyclictest0-21swapper/212:05:492
15247997253,9cyclictest0-21swapper/208:20:592
15247997253,13cyclictest8160-21fschecks_count12:15:452
15239997257,10cyclictest19902-21/usr/sbin/munin08:56:191
15239997255,9cyclictest0-21swapper/107:30:271
15239997251,14cyclictest15223-21cyclictest11:46:001
15239997224,34cyclictest11587-21apt-get08:30:341
15239997214,23cyclictest6868-21seq11:19:561
15239997211,24cyclictest22825-21seq09:04:521
15239997211,24cyclictest21491-21seq07:21:131
15239997211,24cyclictest20356-21seq07:19:021
15233997244,23cyclictest1386-21kworker/u19:1-rpciod12:15:570
15233997231,12cyclictest181rcu_preempt10:29:390
15233997231,12cyclictest181rcu_preempt10:29:390
1525499714,33cyclictest23338-21chrt11:45:583
1525499713,30cyclictest15194-21chrt11:33:043
15247997157,8cyclictest0-21swapper/207:55:572
15247997150,14cyclictest15223-21cyclictest10:00:402
15247997144,18cyclictest19268-21sh11:40:242
15239997155,10cyclictest352-21runrttasks08:16:351
15239997149,16cyclictest12696-21ssh10:35:391
15239997138,11cyclictest29556-21kworker/u17:1-xprtiod11:56:421
15239997138,11cyclictest29556-21kworker/u17:1-xprtiod11:56:421
1523999713,52cyclictest1317-21grep10:15:571
1523999713,27cyclictest0-21swapper/110:10:571
15239997111,24cyclictest9476-21seq12:17:201
15239997111,23cyclictest14468-21seq11:31:031
15233997152,14cyclictest14669-21idleruntime-cro09:45:230
15233997148,9cyclictest181rcu_preempt07:50:270
15233997148,9cyclictest181rcu_preempt07:50:270
15233997148,10cyclictest181rcu_preempt10:32:230
15233997142,21cyclictest25896-21latency_hist07:35:260
15233997140,9cyclictest181rcu_preempt11:40:310
15233997136,20cyclictest31959-21ssh12:00:500
1525499707,28cyclictest514-21chrt11:09:423
1525499703,29cyclictest29741-21chrt07:45:503
1525499703,29cyclictest29741-21chrt07:45:503
1525499703,29cyclictest27921-21chrt11:00:463
1525499702,33cyclictest31881-21taskset09:19:433
15247997056,8cyclictest0-21swapper/208:25:562
15247997051,9cyclictest0-21swapper/208:30:442
15247997046,17cyclictest19753-21sh12:35:232
15247997016,13cyclictest19676-21snmpd10:30:042
15247997016,13cyclictest19676-21snmpd10:30:042
15239997055,10cyclictest6531-21/usr/sbin/munin10:25:581
15239997055,10cyclictest6531-21/usr/sbin/munin10:25:581
15239997054,10cyclictest7585-21munin-run12:15:231
15239997053,11cyclictest277-21dbus-daemon09:50:251
15239997053,11cyclictest277-21dbus-daemon09:50:251
15239997049,14cyclictest21359-21sh11:43:021
15239997023,7cyclictest0-21swapper/112:28:311
15239997023,7cyclictest0-21swapper/112:28:311
15239997012,18cyclictest11285-21seq08:30:061
15239997011,24cyclictest28783-21seq07:42:351
15239997011,24cyclictest28783-21seq07:42:351
1523399703,44cyclictest17408-21head08:45:590
1523399703,39cyclictest15-21ksoftirqd/008:58:370
1461927017,37sleep30-21swapper/307:01:093
1525499694,25cyclictest1315-21taskset10:15:573
1525499693,26cyclictest8653-21taskset12:15:573
15247996955,10cyclictest15223-21cyclictest09:50:402
15247996952,8cyclictest0-21swapper/209:10:552
15239996951,12cyclictest300-21rs:main1
15239996948,13cyclictest12117-21kworker/u19:0-rpciod10:40:521
15239996941,21cyclictest8100-21grep11:20:571
15239996923,37cyclictest0-21swapper/109:30:351
1523399699,36cyclictest15-21ksoftirqd/009:53:210
15233996946,16cyclictest24790-21ssh10:55:430
15233996945,11cyclictest181rcu_preempt08:39:050
15233996942,7cyclictest181rcu_preempt11:22:090
15233996913,29cyclictest15-21ksoftirqd/007:06:020
15233996913,29cyclictest15-21ksoftirqd/007:06:020
1525499683,26cyclictest25886-21taskset10:03:133
1525499683,26cyclictest10247-21chrt11:25:273
15254996816,12cyclictest192162sleep310:45:563
15247996855,7cyclictest0-21swapper/208:40:592
15247996854,8cyclictest0-21swapper/210:45:412
15247996853,8cyclictest0-21swapper/209:00:452
15247996847,13cyclictest0-21swapper/209:05:282
15247996847,13cyclictest0-21swapper/209:05:282
1524799681,26cyclictest0-21swapper/207:44:372
1524799681,26cyclictest0-21swapper/207:44:372
15239996812,18cyclictest9408-21seq08:21:311
15233996847,8cyclictest181rcu_preempt11:50:530
15233996847,8cyclictest181rcu_preempt09:14:300
1523399682,22cyclictest4590-21fschecks_count11:15:440
15233996822,11cyclictest0-21swapper/009:18:460
1525499677,37cyclictest0-21swapper/309:05:473
1525499677,37cyclictest0-21swapper/309:05:473
1525499673,31cyclictest28582-21chrt11:55:383
1525499673,31cyclictest28582-21chrt11:55:383
1525499672,25cyclictest28587-21taskset09:13:563
1525499672,22cyclictest1896-21taskset12:05:273
1525499672,22cyclictest1896-21taskset12:05:273
15254996710,45cyclictest16668-21chrt11:35:443
15247996753,8cyclictest0-21swapper/211:45:242
15247996751,11cyclictest352-21runrttasks09:56:322
15247996751,11cyclictest352-21runrttasks09:56:322
15247996749,12cyclictest22890-21diskmemload09:34:532
15247996748,13cyclictest6486-21latency_hist10:25:272
15247996745,16cyclictest5125-21fschecks_count12:10:442
15247996717,19cyclictest11149-21seq10:32:232
15239996753,8cyclictest0-21swapper/111:36:551
15239996753,8cyclictest0-21swapper/110:10:241
15239996753,10cyclictest15223-21cyclictest09:07:181
15239996753,10cyclictest15223-21cyclictest09:07:181
15239996751,10cyclictest32283-21systemd-run07:55:241
15239996751,10cyclictest1658-21/usr/sbin/munin08:00:511
15233996748,13cyclictest23888-21latency_hist10:00:270
15233996748,13cyclictest23888-21latency_hist10:00:270
15233996747,7cyclictest181rcu_preempt10:38:470
1523399673,51cyclictest538-21/usr/sbin/munin10:15:440
1525499662,23cyclictest10361-21chrt09:36:423
15247996652,9cyclictest27444-21kworker/u18:0-nfsiod09:45:582
15247996652,9cyclictest27444-21kworker/u18:0-nfsiod09:45:582
15247996647,13cyclictest21753-21ssh10:50:442
15247996647,13cyclictest21753-21ssh10:50:442
15247996645,15cyclictest15223-21cyclictest10:10:572
15247996614,11cyclictest0-21swapper/208:20:272
15239996648,11cyclictest24533-21acpi10:55:311
15239996647,11cyclictest0-21swapper/109:50:591
1523999663,24cyclictest25779-21munin-run07:35:241
15239996624,37cyclictest0-21swapper/112:21:161
15239996613,22cyclictest17468-21seq08:46:261
1525499659,15cyclictest0-21swapper/309:45:463
1525499659,15cyclictest0-21swapper/309:45:463
15254996513,14cyclictest0-21swapper/312:10:453
1524799657,23cyclictest6891-21seq11:20:002
15247996553,8cyclictest0-21swapper/211:50:482
15247996552,8cyclictest31168-21sh12:00:242
15247996552,8cyclictest31168-21sh12:00:242
15247996547,12cyclictest22890-21diskmemload10:35:502
15247996517,9cyclictest51322tune2fs08:10:462
1523999659,21cyclictest352-21runrttasks10:24:411
15239996546,13cyclictest25838-21idleruntime11:50:481
15239996527,25cyclictest18630-21grep08:50:561
190762640,6sleep30-21swapper/309:51:013
1525499649,15cyclictest0-21swapper/308:45:453
1525499648,15cyclictest0-21swapper/309:55:433
1525499648,15cyclictest0-21swapper/309:55:433
1525499643,27cyclictest27591-21chrt10:05:523
15254996412,14cyclictest0-21swapper/310:50:593
15254996412,14cyclictest0-21swapper/310:50:593
15247996446,8cyclictest0-21swapper/207:20:262
15239996445,14cyclictest566-21sh12:02:221
15239996422,36cyclictest0-21swapper/109:35:351
1525499637,15cyclictest0-21swapper/307:55:573
1525499633,27cyclictest31964-21taskset10:13:263
15254996311,14cyclictest0-21swapper/308:30:273
15254996310,16cyclictest0-21swapper/308:20:473
15247996350,9cyclictest15223-21cyclictest11:15:132
15247996349,8cyclictest0-21swapper/210:40:582
15247996346,11cyclictest352-21runrttasks07:10:592
15247996344,9cyclictest0-21swapper/208:00:492
15247996317,9cyclictest14031-21ssh09:43:372
15247996314,14cyclictest7332-21runrttasks11:20:332
15239996346,11cyclictest21296-21ssh09:55:451
15239996346,11cyclictest21296-21ssh09:55:451
15239996343,15cyclictest1083-21apt-key11:10:281
1525499629,15cyclictest0-21swapper/308:05:233
1525499627,23cyclictest0-21swapper/308:15:403
15254996212,14cyclictest0-21swapper/308:41:003
15254996211,15cyclictest0-21swapper/310:35:443
15247996245,8cyclictest0-21swapper/207:30:502
1525499612,29cyclictest21293-21chrt07:21:083
15254996112,14cyclictest0-21swapper/312:30:243
15254996112,14cyclictest0-21swapper/312:30:243
1524799613,20cyclictest968-21runrttasks12:03:302
15239996148,9cyclictest15223-21cyclictest10:05:241
15239996146,10cyclictest15223-21cyclictest09:20:261
15239996132,19cyclictest18828-21modprobe07:15:231
15239996127,7cyclictest0-21swapper/108:45:211
15239996121,29cyclictest3007-21sed12:06:001
15239996121,29cyclictest3007-21sed12:06:001
1525499604,37cyclictest17687-21taskset07:10:473
15247996043,7cyclictest0-21swapper/208:05:502
1523999609,23cyclictest0-21swapper/108:00:001
15239996031,20cyclictest27393-21modprobe07:40:241
1525499599,20cyclictest18728-21chrt12:32:403
1525499596,17cyclictest0-21swapper/308:11:003
15254995933,14cyclictest0-21swapper/311:15:423
15247995945,7cyclictest0-21swapper/208:35:582
1523999597,22cyclictest352-21runrttasks08:11:431
1525499579,40cyclictest0-21swapper/307:25:403
1525499563,37cyclictest27707-21chrt11:54:123
1525499553,33cyclictest13186-21taskset08:35:273
1525499543,36cyclictest26617-21chrt07:35:543
1525499543,32cyclictest19388-21taskset07:15:453
1525499532,38cyclictest32224-21chrt12:00:573
1525499523,34cyclictest18808-21chrt08:50:583
1525499522,36cyclictest29127-21chrt07:45:263
1525499522,36cyclictest29127-21chrt07:45:263
1525499514,33cyclictest3866-21chrt08:05:553
1525499503,35cyclictest9762-21chrt10:30:443
1525499502,35cyclictest24501-21chrt07:30:393
1525499492,30cyclictest12589-21chrt09:40:523
1525499484,31cyclictest10447-21chrt11:25:393
1525499484,31cyclictest10447-21chrt11:25:393
1525499373,25cyclictest14498-21taskset08:39:443
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional