You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-15 - 20:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Mon Sep 15, 2025 12:44:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18546997031,28cyclictest38650irq/55-eth010:13:320
18546997031,28cyclictest38650irq/55-eth010:13:320
18548995534,12cyclictest27-21ksoftirqd/211:43:312
18548995534,12cyclictest27-21ksoftirqd/211:43:312
18548995231,13cyclictest27-21ksoftirqd/208:03:322
18548995231,13cyclictest27-21ksoftirqd/208:03:322
1854799524,41cyclictest31460-21snmpd11:38:311
1854899502,10cyclictest0-21swapper/210:28:332
1854899502,10cyclictest0-21swapper/210:28:332
1854799482,33cyclictest23280-21sshd07:33:341
1854799482,33cyclictest23280-21sshd07:33:341
18548994725,12cyclictest27-21ksoftirqd/211:23:322
18548994725,12cyclictest27-21ksoftirqd/211:23:322
18547994520,18cyclictest21-21ksoftirqd/111:08:311
18547994520,18cyclictest21-21ksoftirqd/111:08:311
18547994519,23cyclictest21-21ksoftirqd/108:43:331
18547994519,23cyclictest21-21ksoftirqd/108:43:331
1854699446,5cyclictest131rcu_preempt10:28:330
1854699446,5cyclictest131rcu_preempt10:28:330
1854699432,32cyclictest10828-21ssh10:33:310
1854699432,32cyclictest10828-21ssh10:33:310
18548994227,7cyclictest20412-21diskmemload12:13:332
18548994227,7cyclictest20412-21diskmemload12:13:332
1854799422,30cyclictest2308-21apt-get09:33:321
1854799422,30cyclictest2308-21apt-get09:33:321
1854799422,30cyclictest2308-21apt-get09:33:321
1854699402,31cyclictest0-21swapper/010:48:340
1854699402,31cyclictest0-21swapper/010:48:340
1854899394,27cyclictest2346-21ssh09:33:342
1854899394,27cyclictest2346-21ssh09:33:342
1854899394,27cyclictest2346-21ssh09:33:342
1854899391,32cyclictest30353-21ssh12:33:322
1854899391,32cyclictest30353-21ssh12:33:322
1854899391,30cyclictest27659-21systemd-journal07:28:332
1854899391,30cyclictest27659-21systemd-journal07:28:332
1854799392,28cyclictest21097-21ssh11:33:311
1854899382,26cyclictest29250-21sshd07:53:332
1854899382,26cyclictest29250-21sshd07:53:332
1854899381,31cyclictest31994-21sh11:48:312
1854899381,31cyclictest31994-21sh11:48:312
1854699383,24cyclictest12-21ksoftirqd/011:48:310
1854699383,24cyclictest12-21ksoftirqd/011:48:310
1854899377,18cyclictest1865-21ssh12:38:322
1854899377,18cyclictest1865-21ssh12:38:322
1854799375,26cyclictest26029-21ssh10:08:351
1854799375,26cyclictest26029-21ssh10:08:351
18548993618,10cyclictest27-21ksoftirqd/210:33:312
18548993618,10cyclictest27-21ksoftirqd/210:33:312
1854699362,23cyclictest38650irq/55-eth009:43:320
1854699362,23cyclictest38650irq/55-eth009:43:320
1854899357,22cyclictest31171-21ssh09:28:322
1854899357,22cyclictest31171-21ssh09:28:322
18548993520,7cyclictest27-21ksoftirqd/209:48:322
1854699358,24cyclictest12-21ksoftirqd/010:38:320
1854699358,24cyclictest12-21ksoftirqd/010:38:320
1854699358,24cyclictest12-21ksoftirqd/010:38:320
18548993418,6cyclictest27-21ksoftirqd/208:28:322
18548993418,6cyclictest27-21ksoftirqd/208:28:322
18548993417,9cyclictest27-21ksoftirqd/211:08:302
18548993417,9cyclictest27-21ksoftirqd/211:08:302
1854899341,20cyclictest29409-21ssh10:13:322
1854899341,20cyclictest29409-21ssh10:13:322
1854799341,24cyclictest20412-21diskmemload11:58:321
1854799341,24cyclictest20412-21diskmemload11:58:321
18546993420,12cyclictest38650irq/55-eth010:08:350
18546993420,12cyclictest38650irq/55-eth010:08:350
1854799322,24cyclictest31176-21ssh09:28:321
1854799322,24cyclictest31176-21ssh09:28:321
1854699326,20cyclictest38650irq/55-eth010:03:320
1854699326,20cyclictest38650irq/55-eth010:03:320
1854899312,25cyclictest17515-21sendmail-msp09:03:312
1854899312,25cyclictest17515-21sendmail-msp09:03:312
1854899311,23cyclictest12676-21ssh12:08:272
1854899311,23cyclictest12676-21ssh12:08:272
1854799313,20cyclictest15865-21kworker/u8:111:03:341
1854799313,20cyclictest15865-21kworker/u8:111:03:341
1854799312,23cyclictest27374-21sendmail-msp09:23:331
1854799312,23cyclictest27374-21sendmail-msp09:23:331
1854799312,23cyclictest0-21swapper/109:13:321
1854799312,23cyclictest0-21swapper/109:13:321
1854699312,22cyclictest3326-21/usr/sbin/munin11:53:300
1854699312,21cyclictest31996-21sendmail-msp08:03:330
1854699312,21cyclictest31996-21sendmail-msp08:03:330
1854799303,22cyclictest22971-21ssh10:03:321
1854799303,22cyclictest22971-21ssh10:03:321
18547993018,7cyclictest5620-21sh09:38:331
18547993018,7cyclictest5620-21sh09:38:331
1854799301,21cyclictest12417-21latency_hist12:08:271
1854799301,21cyclictest12417-21latency_hist12:08:271
1854699303,21cyclictest0-21swapper/012:18:310
1854699303,21cyclictest0-21swapper/012:18:310
1854699303,18cyclictest38650irq/55-eth011:38:310
1854699302,17cyclictest38650irq/55-eth007:53:320
1854699302,17cyclictest38650irq/55-eth007:53:320
1854699301,5cyclictest0-21swapper/011:58:310
1854699301,5cyclictest0-21swapper/011:58:310
1854899294,17cyclictest27-21ksoftirqd/211:53:302
1855099288,15cyclictest0-21swapper/311:33:313
18547992819,4cyclictest19195-21apt-get09:08:321
18547992819,4cyclictest19195-21apt-get09:08:321
1854699281,22cyclictest24108-21sh09:18:320
1854699281,22cyclictest24108-21sh09:18:320
1854699281,20cyclictest0-21swapper/011:28:320
1854699281,20cyclictest0-21swapper/011:28:320
1855099273,17cyclictest0-21swapper/310:48:273
1855099273,17cyclictest0-21swapper/310:48:273
18548992710,9cyclictest9260-21ssh09:43:322
18548992710,9cyclictest9260-21ssh09:43:322
1854799272,20cyclictest17356-21ssh11:28:321
1854799272,20cyclictest17356-21ssh11:28:321
1854799272,11cyclictest16160-21ssh09:53:301
1854799272,11cyclictest16160-21ssh09:53:301
18547992715,9cyclictest12752-21apt-get09:48:311
18547992714,10cyclictest9253-21apt-get09:43:331
18547992714,10cyclictest9253-21apt-get09:43:331
1854699279,15cyclictest13577-21kworker/0:011:18:310
1854699279,15cyclictest13577-21kworker/0:011:18:310
1855099267,15cyclictest0-21swapper/311:28:323
1855099267,15cyclictest0-21swapper/311:28:323
1855099262,19cyclictest0-21swapper/310:53:273
1855099262,19cyclictest0-21swapper/310:53:273
1854799262,19cyclictest9922-21apt-get08:38:291
1854799262,19cyclictest9922-21apt-get08:38:291
18547992613,10cyclictest24750-21apt-get10:53:271
18547992613,10cyclictest24750-21apt-get10:53:271
1854699262,19cyclictest12761-21ssh09:48:310
1854699261,21cyclictest0-21swapper/007:23:300
1854699261,21cyclictest0-21swapper/007:23:300
1854699261,20cyclictest38650irq/55-eth009:33:350
1854699261,20cyclictest38650irq/55-eth009:33:350
1854699261,20cyclictest38650irq/55-eth009:33:350
1854799259,9cyclictest18545-21cyclictest08:58:311
1854799259,9cyclictest18545-21cyclictest08:58:311
1854799254,6cyclictest21-21ksoftirqd/111:18:371
1854799254,6cyclictest21-21ksoftirqd/111:18:371
1854799254,16cyclictest14303-21ssh10:38:321
1854799254,16cyclictest14303-21ssh10:38:321
1854799254,16cyclictest14303-21ssh10:38:321
1854799253,16cyclictest27659-21systemd-journal07:18:311
1854799253,16cyclictest27659-21systemd-journal07:18:311
1854799252,17cyclictest13744-21sendmail-msp11:23:311
1854799252,17cyclictest13744-21sendmail-msp11:23:311
1854799251,20cyclictest28441-21diskmemload11:43:331
1854799251,20cyclictest28441-21diskmemload11:43:331
1854699253,17cyclictest19607-21ssh09:58:330
1854699251,20cyclictest0-21swapper/010:43:320
1854699251,20cyclictest0-21swapper/010:43:320
1855099246,13cyclictest0-21swapper/307:33:343
1855099246,13cyclictest0-21swapper/307:33:343
1855099244,16cyclictest0-21swapper/311:38:313
1855099241,19cyclictest0-21swapper/309:23:453
1855099241,19cyclictest0-21swapper/309:23:453
1855099241,18cyclictest0-21swapper/309:13:443
1855099241,18cyclictest0-21swapper/309:13:443
1855099241,18cyclictest0-21swapper/308:18:463
1855099241,18cyclictest0-21swapper/308:18:463
1854899245,10cyclictest30873-21in:imuxsock08:23:312
1854899242,18cyclictest19198-21sshd09:08:332
1854899242,18cyclictest19198-21sshd09:08:332
1854899242,17cyclictest24801-21latency_hist10:53:292
18547992413,7cyclictest19598-21apt-get09:58:321
1854799241,17cyclictest24101-21ssh09:18:311
1854799241,17cyclictest24101-21ssh09:18:311
18546992418,4cyclictest31460-21snmpd10:58:380
18546992418,4cyclictest31460-21snmpd10:58:380
18546992418,4cyclictest31460-21snmpd10:58:380
1854699241,20cyclictest0-21swapper/008:33:310
1854699241,20cyclictest0-21swapper/008:33:310
1854699241,18cyclictest1-21systemd09:08:330
1854699241,18cyclictest1-21systemd09:08:330
1855099231,18cyclictest0-21swapper/312:28:463
1855099231,18cyclictest0-21swapper/312:28:463
1855099231,18cyclictest0-21swapper/311:58:313
1855099231,18cyclictest0-21swapper/311:58:313
1855099231,18cyclictest0-21swapper/311:23:323
1855099231,18cyclictest0-21swapper/311:23:323
1855099231,17cyclictest0-21swapper/311:08:433
1855099231,17cyclictest0-21swapper/311:08:433
1855099231,17cyclictest0-21swapper/308:03:323
1855099231,17cyclictest0-21swapper/308:03:323
1855099231,17cyclictest0-21swapper/307:23:303
1855099231,17cyclictest0-21swapper/307:23:303
1854899235,10cyclictest27-21ksoftirqd/210:53:272
1854799237,4cyclictest0-21swapper/112:13:441
1854799237,4cyclictest0-21swapper/112:13:441
1854799233,4cyclictest21-21ksoftirqd/108:48:321
1854799233,4cyclictest21-21ksoftirqd/108:48:321
18547992311,10cyclictest21-21ksoftirqd/109:03:331
18547992311,10cyclictest21-21ksoftirqd/109:03:331
18546992319,3cyclictest25095-1kworker/0:0H09:28:450
18546992319,3cyclictest25095-1kworker/0:0H09:28:450
18546992314,6cyclictest38650irq/55-eth009:23:450
18546992314,6cyclictest38650irq/55-eth009:23:450
1855099227,12cyclictest0-21swapper/310:58:323
1855099227,12cyclictest0-21swapper/310:58:323
1855099227,12cyclictest0-21swapper/310:58:323
1855099221,4cyclictest0-21swapper/308:48:403
1855099221,4cyclictest0-21swapper/308:48:403
1855099221,4cyclictest0-21swapper/307:43:433
1855099221,4cyclictest0-21swapper/307:43:433
1855099221,18cyclictest0-21swapper/309:48:443
1855099221,18cyclictest0-21swapper/307:18:433
1855099221,18cyclictest0-21swapper/307:18:433
1855099221,17cyclictest0-21swapper/311:53:303
1855099221,17cyclictest0-21swapper/311:03:473
1855099221,17cyclictest0-21swapper/311:03:473
1855099221,16cyclictest0-21swapper/308:28:343
1855099221,16cyclictest0-21swapper/308:28:343
1854899224,15cyclictest14294-21apt-get10:38:312
1854899224,15cyclictest14294-21apt-get10:38:312
1854899224,15cyclictest14294-21apt-get10:38:312
1854899222,16cyclictest2754-21apt-get08:13:302
1854899221,16cyclictest28499-21ssh10:58:322
1854899221,16cyclictest28499-21ssh10:58:322
1854899221,16cyclictest28499-21ssh10:58:322
1854799227,4cyclictest0-21swapper/110:31:141
1854799227,4cyclictest0-21swapper/110:31:141
1854799226,4cyclictest0-21swapper/110:19:371
1854799226,4cyclictest0-21swapper/110:19:371
1854799226,12cyclictest0-21swapper/111:13:311
1854799226,12cyclictest0-21swapper/111:13:311
1854799221,6cyclictest21-21ksoftirqd/108:13:431
18547992216,4cyclictest0-21swapper/108:08:421
18547992216,3cyclictest0-21swapper/112:18:321
18547992216,3cyclictest0-21swapper/112:18:321
1854799221,3cyclictest0-21swapper/108:23:451
1854799221,17cyclictest14924-21cut08:53:351
1854799221,17cyclictest14924-21cut08:53:351
1854699222,3cyclictest131rcu_preempt12:38:320
1854699222,3cyclictest131rcu_preempt12:38:320
1854699222,16cyclictest1-21systemd10:53:290
1854699222,16cyclictest1-21systemd10:53:290
18546992217,3cyclictest25095-1kworker/0:0H08:58:390
18546992217,3cyclictest25095-1kworker/0:0H08:58:390
1854699221,17cyclictest5723-21apt-get08:23:310
1855099213,14cyclictest0-21swapper/310:28:333
1855099213,14cyclictest0-21swapper/310:28:333
1855099212,15cyclictest0-21swapper/311:43:313
1855099212,15cyclictest0-21swapper/311:43:313
1855099212,15cyclictest0-21swapper/310:03:333
1855099212,15cyclictest0-21swapper/310:03:333
1855099212,15cyclictest0-21swapper/309:38:323
1855099212,15cyclictest0-21swapper/309:38:323
1855099211,3cyclictest0-21swapper/308:43:453
1855099211,3cyclictest0-21swapper/308:43:453
1855099211,3cyclictest0-21swapper/307:48:413
1855099211,3cyclictest0-21swapper/307:48:413
1855099211,17cyclictest0-21swapper/312:13:463
1855099211,17cyclictest0-21swapper/312:13:463
1855099211,17cyclictest0-21swapper/310:38:303
1855099211,17cyclictest0-21swapper/310:38:303
1855099211,17cyclictest0-21swapper/310:38:303
1855099211,17cyclictest0-21swapper/310:08:473
1855099211,17cyclictest0-21swapper/310:08:473
1855099211,17cyclictest0-21swapper/309:28:443
1855099211,17cyclictest0-21swapper/309:28:443
1855099211,16cyclictest0-21swapper/312:33:443
1855099211,16cyclictest0-21swapper/312:33:443
1855099211,16cyclictest0-21swapper/311:48:303
1855099211,16cyclictest0-21swapper/311:48:303
1855099211,16cyclictest0-21swapper/311:18:313
1855099211,16cyclictest0-21swapper/311:18:313
1855099211,16cyclictest0-21swapper/311:13:313
1855099211,16cyclictest0-21swapper/311:13:313
1855099211,16cyclictest0-21swapper/310:23:283
1855099211,16cyclictest0-21swapper/310:13:453
1855099211,16cyclictest0-21swapper/310:13:453
1855099211,16cyclictest0-21swapper/309:33:353
1855099211,16cyclictest0-21swapper/309:33:353
1855099211,16cyclictest0-21swapper/309:33:353
1855099211,16cyclictest0-21swapper/309:08:353
1855099211,16cyclictest0-21swapper/309:08:353
1855099211,16cyclictest0-21swapper/308:53:323
1855099211,16cyclictest0-21swapper/308:53:323
1855099211,16cyclictest0-21swapper/308:08:423
1855099211,15cyclictest0-21swapper/312:23:323
1855099211,13cyclictest0-21swapper/312:38:313
1855099211,13cyclictest0-21swapper/312:38:313
1854899212,4cyclictest131rcu_preempt07:18:332
1854899212,4cyclictest131rcu_preempt07:18:332
1854899211,17cyclictest14154-21ls08:48:402
1854899211,17cyclictest14154-21ls08:48:402
1854899211,16cyclictest27659-21systemd-journal10:53:292
1854899211,16cyclictest27659-21systemd-journal10:53:292
18548992110,3cyclictest131rcu_preempt09:23:302
18548992110,3cyclictest131rcu_preempt09:23:302
1854799213,5cyclictest201rcuc/111:56:591
1854799212,7cyclictest21-21ksoftirqd/112:08:391
1854799212,7cyclictest21-21ksoftirqd/112:08:391
1854799212,5cyclictest21-21ksoftirqd/110:48:271
1854799212,5cyclictest21-21ksoftirqd/110:48:271
1854799212,15cyclictest26240-21apt-get07:43:291
1854799212,15cyclictest26240-21apt-get07:43:291
18547992112,3cyclictest0-21swapper/108:18:331
18547992112,3cyclictest0-21swapper/108:18:331
1854799211,16cyclictest30349-21ssh12:33:311
1854799211,16cyclictest30349-21ssh12:33:311
18547992111,6cyclictest0-21swapper/112:38:451
18547992111,6cyclictest0-21swapper/112:38:451
1854699219,9cyclictest27277-21apt-get12:28:330
1854699219,9cyclictest27277-21apt-get12:28:330
1854699218,6cyclictest23480-21sendmail-msp12:23:540
1854699212,9cyclictest28888-21grep07:48:430
1854699212,9cyclictest28888-21grep07:48:430
1854699211,9cyclictest25992-21latency_hist07:43:190
1854699211,9cyclictest25992-21latency_hist07:43:190
1854699211,9cyclictest15451-21proc_pri08:53:420
1854699211,9cyclictest15451-21proc_pri08:53:420
1854699211,18cyclictest5841-21cut09:38:350
1854699211,18cyclictest5841-21cut09:38:350
1854699211,17cyclictest32275-21ls11:03:380
1854699211,17cyclictest32275-21ls11:03:380
1854699211,15cyclictest16572-21sh12:13:330
1854699211,15cyclictest16572-21sh12:13:330
18546992110,9cyclictest0-21swapper/009:53:310
18546992110,9cyclictest0-21swapper/009:53:310
1855099201,3cyclictest0-21swapper/308:23:443
1855099201,3cyclictest0-21swapper/307:58:453
1855099201,3cyclictest0-21swapper/307:58:453
1855099201,3cyclictest0-21swapper/307:38:443
1855099201,3cyclictest0-21swapper/307:38:443
1855099201,3cyclictest0-21swapper/307:28:363
1855099201,3cyclictest0-21swapper/307:28:363
1855099201,2cyclictest0-21swapper/307:13:553
1855099201,2cyclictest0-21swapper/307:13:553
1855099201,16cyclictest0-21swapper/312:18:443
1855099201,16cyclictest0-21swapper/312:18:443
1855099201,16cyclictest0-21swapper/312:08:263
1855099201,16cyclictest0-21swapper/312:08:263
1855099201,16cyclictest0-21swapper/310:23:423
1855099201,16cyclictest0-21swapper/310:23:423
1855099201,16cyclictest0-21swapper/309:18:443
1855099201,16cyclictest0-21swapper/309:18:443
1855099201,16cyclictest0-21swapper/309:03:313
1855099201,16cyclictest0-21swapper/309:03:313
1855099201,15cyclictest0-21swapper/312:08:393
1855099201,15cyclictest0-21swapper/312:08:393
1855099201,15cyclictest0-21swapper/310:33:443
1855099201,15cyclictest0-21swapper/310:33:443
1855099201,15cyclictest0-21swapper/310:18:323
1855099201,15cyclictest0-21swapper/309:53:433
1855099201,15cyclictest0-21swapper/309:53:433
1855099201,15cyclictest0-21swapper/309:43:323
1855099201,15cyclictest0-21swapper/309:43:323
1855099201,15cyclictest0-21swapper/308:13:303
1854899205,12cyclictest20068-21sendmail-msp07:23:332
1854899205,12cyclictest20068-21sendmail-msp07:23:332
1854899202,15cyclictest27773-21apt-get07:48:282
1854899202,15cyclictest27773-21apt-get07:48:282
18548992013,5cyclictest20412-21diskmemload11:03:352
18548992013,5cyclictest20412-21diskmemload11:03:352
18548992013,5cyclictest0-21swapper/210:48:282
18548992013,4cyclictest4642-21grep10:23:392
18548992013,4cyclictest4642-21grep10:23:392
1854799209,9cyclictest29245-21apt-get07:53:321
1854799209,9cyclictest29245-21apt-get07:53:321
1854799205,7cyclictest21-21ksoftirqd/110:24:221
1854799205,7cyclictest21-21ksoftirqd/110:24:221
1854799203,8cyclictest0-21swapper/110:59:281
1854799203,8cyclictest0-21swapper/110:59:281
1854799203,8cyclictest0-21swapper/110:59:281
1854799203,4cyclictest21-21ksoftirqd/110:13:391
1854799203,4cyclictest21-21ksoftirqd/110:13:391
1854799202,4cyclictest21-21ksoftirqd/107:48:281
1854799202,4cyclictest21-21ksoftirqd/107:48:281
18547992012,6cyclictest8087-21swap08:28:431
18547992012,6cyclictest8087-21swap08:28:431
1854799201,15cyclictest8719-21apt-get08:33:311
1854799201,15cyclictest8719-21apt-get08:33:311
18547992010,7cyclictest0-21swapper/107:18:261
18547992010,7cyclictest0-21swapper/107:18:261
1854699202,4cyclictest131rcu_preempt10:23:420
1854699202,4cyclictest131rcu_preempt10:23:420
1854699202,15cyclictest38650irq/55-eth007:58:330
1854699202,15cyclictest38650irq/55-eth007:58:330
1854699202,15cyclictest38650irq/55-eth007:33:330
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional