You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-28 - 04:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack2slot7.osadl.org (updated Thu Aug 28, 2025 00:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2409464994226,13cyclictest111788-21systemd-journal22:44:441
240946399422,39cyclictest2498656-21awk22:12:250
240946399411,26cyclictest0-21swapper/023:57:260
240946399391,12cyclictest2598431-21true00:09:420
2409463993818,5cyclictest2468227-21ssh21:37:170
240946399375,13cyclictest2545544-21ntpq23:07:210
240946399365,23cyclictest2549050-21/usr/sbin/munin23:12:150
240946399361,22cyclictest0-21swapper/021:27:170
240946799357,19cyclictest2243333-21munin-node23:19:462
240946499343,11cyclictest2409465-21sh19:14:431
2409464993428,5cyclictest0-21swapper/121:54:451
2409463993417,3cyclictest0-21swapper/020:19:590
240946399330,24cyclictest0-21swapper/000:12:230
240946399325,21cyclictest605-21avahi-daemon00:27:400
240946399311,28cyclictest2511525-21systemctl22:27:230
240946499306,8cyclictest2508714-21sendmail-msp22:26:251
240946399301,11cyclictest0-21swapper/023:38:170
2409464992913,3cyclictest2612793-21unixbench_multi00:27:371
2409464992912,4cyclictest2417076-21ntp_kernel_pll_19:37:231
240946499283,8cyclictest2449677-21diskmemload23:19:451
240946399283,8cyclictest171rcu_preempt23:19:460
2409463992813,2cyclictest0-21swapper/022:47:210
240946399280,20cyclictest0-21swapper/022:57:050
240946399280,19cyclictest0-21swapper/023:42:050
2409467992723,3cyclictest1008-21mta-sts-daemon23:02:222
240946499273,9cyclictest2447620-21/usr/sbin/munin21:07:251
240946499271,10cyclictest2541085-21/usr/sbin/munin23:02:201
240946499262,3cyclictest0-21swapper/123:17:211
2409464992614,4cyclictest2436414-21grep20:32:281
2409464992612,3cyclictest2532526-21ntp_kernel_err22:52:231
2409464992612,3cyclictest2532526-21ntp_kernel_err22:52:231
240946399266,5cyclictest171rcu_preempt00:02:210
240946399262,22cyclictest2514594-21/usr/sbin/munin22:32:150
2409463992618,1cyclictest2553674-21if_wlan023:17:170
2409463992612,1cyclictest0-21swapper/023:46:350
240946799253,9cyclictest0-21swapper/221:57:172
240946499257,3cyclictest2438073-21sed20:37:271
112699250,3rtkit-daemon1125-21rtkit-daemon21:53:090
240946799247,12cyclictest1008-21mta-sts-daemon21:32:542
240946799243,16cyclictest111788-21systemd-journal20:05:012
240946799242,2cyclictest171rcu_preempt23:27:202
240946799242,2cyclictest171rcu_preempt23:27:202
240946799241,3cyclictest171rcu_preempt23:07:212
240946799240,5cyclictest0-21swapper/222:24:482
240946499244,13cyclictest2593386-21ssh00:02:531
240946499243,9cyclictest2545644-21ssh23:07:231
240946499242,4cyclictest2494355-21ntpq22:07:241
240946399241,4cyclictest2486628-21grep21:57:280
240946799232,4cyclictest171rcu_preempt22:47:232
240946799231,7cyclictest69-21kswapd020:29:452
240946499233,9cyclictest2434655-21latency_hist20:29:431
240946399230,22cyclictest259-21jbd2/mmcblk0p2-821:46:470
240946399230,22cyclictest259-21jbd2/mmcblk0p2-821:46:470
2409467992217,3cyclictest2434453-21grep20:27:272
2409467992216,4cyclictest2507404-21grep22:22:292
2409464992217,3cyclictest0-21swapper/123:44:581
240946399225,9cyclictest2560797-21ssh23:25:090
240946399225,9cyclictest2560797-21ssh23:25:090
240946399225,8cyclictest2434515-21apt-get20:29:450
240946399222,15cyclictest2464974-21ntpq21:32:210
240946399221,0cyclictest0-21swapper/022:05:120
240946399220,0cyclictest0-21swapper/000:17:280
112699220,5rtkit-daemon1005-21mta-sts-daemon22:03:240
240946799214,13cyclictest2578991-21ssh23:47:152
2409467992118,2cyclictest2493987-21gltestperf22:07:212
2409463992119,1cyclictest0-21swapper/023:32:180
240946399211,4cyclictest2624439-21latency_hist00:44:430
240946799204,3cyclictest171rcu_preempt22:12:252
240946799203,4cyclictest171rcu_preempt23:17:202
240946799203,3cyclictest171rcu_preempt20:09:462
240946499204,14cyclictest2562811-21ssh23:27:221
240946499204,14cyclictest2562811-21ssh23:27:221
2409464992011,3cyclictest0-21swapper/100:22:261
240946399204,4cyclictest171rcu_preempt22:24:440
240946399202,14cyclictest2525499-21ls22:44:430
240946399201,18cyclictest0-21swapper/022:37:270
240946399201,18cyclictest0-21swapper/020:42:200
240946799193,12cyclictest2621846-21ssh00:42:162
240946799191,5cyclictest171rcu_preempt22:39:192
2409467991915,2cyclictest2456125-21gltestperf21:22:192
240946799191,14cyclictest2611667-21ssh00:27:262
240946499194,12cyclictest2506702-21ssh22:22:221
240946499192,8cyclictest2413890-21ntpq19:27:251
240946499192,8cyclictest2409680-21/usr/sbin/munin19:17:141
240946499191,10cyclictest1008-21mta-sts-daemon19:47:241
240946399192,14cyclictest0-21swapper/022:52:210
240946399192,14cyclictest0-21swapper/022:52:210
2409463991915,3cyclictest2504490-21latency_hist22:19:430
240946399191,16cyclictest2584474-21/usr/sbin/munin23:52:290
240946799187,1cyclictest171rcu_preempt23:44:432
240946799186,1cyclictest171rcu_preempt21:47:262
240946799186,1cyclictest171rcu_preempt21:47:262
240946799182,1cyclictest171rcu_preempt00:19:432
240946799182,10cyclictest2468442-21rm21:37:182
2409467991815,1cyclictest0-21swapper/223:52:212
2409467991813,4cyclictest2424778-21fschecks_count20:02:162
2409467991813,3cyclictest0-21swapper/222:44:432
240946799181,2cyclictest2421573-21fschecks_time19:52:172
240946499189,5cyclictest0-21swapper/121:47:311
240946499189,5cyclictest0-21swapper/121:47:311
240946499185,8cyclictest1007-21mta-sts-daemon20:02:201
240946499183,13cyclictest2603729-21aten_r2power_fr00:17:171
2409464991813,4cyclictest2423634-21ntp_kernel_err19:57:201
2409464991813,3cyclictest0-21swapper/122:04:431
240946399189,5cyclictest0-21swapper/021:22:220
240946399188,1cyclictest0-21swapper/021:07:160
240946399185,10cyclictest2432889-21sendmail-msp20:24:490
240946399183,8cyclictest2445691-21/usr/sbin/munin21:02:190
240946399183,11cyclictest2429446-21unixbench_multi20:12:270
240946399182,11cyclictest11050irq/107-eth%d20:52:230
240946799175,9cyclictest2587475-21/usr/sbin/munin23:57:262
240946799173,10cyclictest607-21dbus-daemon00:04:422
240946799172,5cyclictest2600946-21/usr/sbin/munin00:12:322
240946799172,4cyclictest0-21swapper/221:26:442
2409467991714,2cyclictest2533114-21unixbench_multi22:52:292
2409467991714,2cyclictest2533114-21unixbench_multi22:52:292
2409467991713,3cyclictest2411559-21cpuspeed19:22:152
2409467991712,4cyclictest2420860-21grep19:47:282
240946499172,11cyclictest2616360-21switchtime00:32:321
240946499171,9cyclictest2584535-21sed23:52:291
2409464991713,2cyclictest2523368-21gltestperf22:42:211
240946399177,3cyclictest2416680-21grep19:37:200
240946399174,3cyclictest11050irq/107-eth%d23:02:200
240946399172,14cyclictest2615348-21ssh00:32:180
240946399172,13cyclictest2440407-21fschecks_time20:47:160
2409463991712,4cyclictest2619470-21ntp_kernel_pll_00:37:270
240946799168,7cyclictest0-21swapper/222:57:212
240946799165,5cyclictest2607451-21/usr/sbin/munin00:22:132
240946799164,9cyclictest2514874-21/usr/sbin/munin22:32:152
240946799163,1cyclictest2617577-21apt00:34:432
240946799161,6cyclictest2446627-21/usr/sbin/munin21:07:252
240946499164,10cyclictest2537272-21ssh22:57:281
240946499163,9cyclictest2549606-21ssh23:12:201
240946499163,8cyclictest11050irq/107-eth%d20:22:231
240946499163,6cyclictest11050irq/107-eth%d23:57:261
240946499162,9cyclictest2412662-21grep19:22:261
240946499162,2cyclictest11050irq/107-eth%d22:17:201
240946499161,3cyclictest0-21swapper/123:42:171
2409464991613,2cyclictest2457123-21unixbench_singl21:22:291
2409464991611,2cyclictest1008-21mta-sts-daemon21:27:161
2409464991611,1cyclictest0-21swapper/123:37:281
240946399162,11cyclictest2424183-21/usr/sbin/munin19:57:270
2409463991614,1cyclictest0-21swapper/021:41:550
240946899154,8cyclictest0-21swapper/323:07:213
240946799157,2cyclictest171rcu_preempt20:59:432
240946799155,5cyclictest2446336-21/usr/sbin/munin21:02:282
240946799154,6cyclictest2549670-21/usr/sbin/munin23:12:202
240946799154,6cyclictest2419324-21grep19:44:432
240946799154,10cyclictest2481243-21if_wlan021:52:182
240946799153,9cyclictest2570904-21/usr/sbin/munin23:37:182
240946799153,10cyclictest2618662-21aten_r2power_cu00:37:172
240946799152,9cyclictest2565388-21ssh23:31:032
240946799152,9cyclictest2432417-21/usr/sbin/munin20:22:252
240946799151,4cyclictest2417680-21latency_hist19:39:422
2409467991511,3cyclictest351ktimers/222:02:202
240946499159,4cyclictest2568843-21latency_hist23:34:431
240946499156,8cyclictest271ktimers/120:57:221
240946499155,8cyclictest0-21swapper/122:32:251
240946499152,7cyclictest2468575-21gltestperf21:37:191
240946499152,4cyclictest2482132-21grep21:52:271
240946499151,2cyclictest11050irq/107-eth%d21:41:071
240946499151,2cyclictest0-21swapper/122:37:311
2409464991512,3cyclictest1007-21mta-sts-daemon21:30:121
2409464991512,2cyclictest2499086-21unixbench_multi22:12:301
240946499151,11cyclictest2621847-21/usr/sbin/munin00:42:161
240946499151,10cyclictest2451830-21gltestperf21:17:181
240946399154,8cyclictest2418059-21aten_r2power_vo19:42:130
240946399151,10cyclictest2608289-21/usr/sbin/munin00:22:190
240946899143,5cyclictest0-21swapper/321:22:223
240946899143,5cyclictest0-21swapper/300:26:353
240946899142,7cyclictest0-21swapper/319:52:183
240946899142,7cyclictest0-21swapper/300:22:233
240946899141,9cyclictest0-21swapper/322:12:253
240946899141,8cyclictest0-21swapper/320:12:273
240946899140,8cyclictest0-21swapper/322:47:203
240946799146,5cyclictest2437006-21/usr/sbin/munin20:37:162
240946799145,3cyclictest171rcu_preempt19:34:432
240946799142,9cyclictest2451892-21ssh21:17:182
240946799142,4cyclictest2439797-21idleruntime-cro20:44:432
240946799142,11cyclictest2440039-21/usr/sbin/munin20:47:142
240946799142,10cyclictest2500687-21ssh22:15:062
240946799141,12cyclictest2448635-21fschecks_time21:12:192
240946799141,11cyclictest2413742-21uname19:27:222
240946799140,3cyclictest171rcu_preempt20:17:162
240946499146,5cyclictest0-21swapper/119:42:171
240946499142,2cyclictest0-21swapper/120:17:161
240946499142,11cyclictest2428862-21wc20:12:191
240946499141,8cyclictest2439794-21munin-plugin-st20:44:431
240946399145,7cyclictest2419884-21fschecks_count19:47:190
240946399142,5cyclictest2243333-21munin-node20:07:220
240946399142,11cyclictest2452200-21grep21:17:210
240946399141,12cyclictest2424802-21cut20:02:160
2409463991411,2cyclictest0-21swapper/020:37:230
240946899135,5cyclictest0-21swapper/300:12:233
240946899132,5cyclictest0-21swapper/320:02:173
240946899132,5cyclictest0-21swapper/319:22:173
240946899131,6cyclictest0-21swapper/321:27:493
240946899131,3cyclictest0-21swapper/321:32:213
240946899130,6cyclictest0-21swapper/319:45:403
240946799136,6cyclictest351ktimers/200:07:142
240946799133,7cyclictest2411006-21/usr/sbin/munin19:17:262
240946799131,10cyclictest2423212-21cut19:57:172
240946499134,5cyclictest2427576-21munin-run20:09:431
240946499132,9cyclictest2441990-21fschecks_count20:52:191
240946499132,6cyclictest2440399-21fschecks_time20:47:161
240946499132,5cyclictest2446373-21munin-run21:04:431
240946499131,8cyclictest2421499-21fschecks_count19:52:171
240946499131,5cyclictest0-21swapper/100:05:201
240946399137,3cyclictest0-21swapper/021:12:200
240946399134,8cyclictest2429875-21/usr/sbin/munin20:17:160
240946399134,7cyclictest2409989-21grep19:17:160
240946399132,7cyclictest2422585-21/usr/sbin/munin19:52:270
2409463991310,0cyclictest0-21swapper/019:22:140
240946899124,3cyclictest0-21swapper/321:02:223
240946899123,4cyclictest0-21swapper/321:17:263
240946899122,6cyclictest0-21swapper/300:02:183
240946899122,5cyclictest0-21swapper/300:32:173
240946899122,4cyclictest0-21swapper/323:11:393
240946899121,7cyclictest0-21swapper/323:02:193
240946799127,2cyclictest0-21swapper/221:42:162
240946799121,2cyclictest171rcu_preempt20:52:242
240946499121,9cyclictest2618925-21grep00:37:221
240946499121,8cyclictest2448315-21/usr/sbin/munin21:12:151
240946499121,8cyclictest2414990-21fschecks_time19:32:171
240946499120,11cyclictest2600296-21iwlist00:12:231
240946399127,2cyclictest0-21swapper/020:57:200
240946399123,7cyclictest2413968-21/usr/sbin/munin19:27:260
240946399121,7cyclictest0-21swapper/019:32:250
112699120,1rtkit-daemon0-21swapper/019:11:250
240946899114,5cyclictest0-21swapper/323:27:183
240946899114,5cyclictest0-21swapper/323:27:183
240946899114,4cyclictest0-21swapper/322:24:483
240946899114,4cyclictest0-21swapper/321:07:193
240946899114,3cyclictest0-21swapper/323:42:233
240946899114,3cyclictest0-21swapper/320:07:113
240946899113,5cyclictest0-21swapper/320:17:243
240946899113,4cyclictest0-21swapper/322:52:213
240946899113,4cyclictest0-21swapper/322:52:213
240946899112,6cyclictest0-21swapper/322:22:243
240946899112,6cyclictest0-21swapper/300:17:213
240946899112,5cyclictest0-21swapper/323:57:253
240946899112,5cyclictest0-21swapper/323:52:203
240946899112,5cyclictest0-21swapper/322:57:173
240946899112,5cyclictest0-21swapper/322:32:143
240946899112,4cyclictest0-21swapper/323:19:453
240946899111,7cyclictest0-21swapper/321:37:193
240946899111,5cyclictest0-21swapper/322:39:193
240946899110,6cyclictest0-21swapper/300:07:213
240946899110,5cyclictest0-21swapper/300:37:163
240946899105,3cyclictest0-21swapper/323:34:443
240946899104,3cyclictest0-21swapper/320:29:453
240946899103,4cyclictest0-21swapper/320:47:203
240946899103,3cyclictest0-21swapper/320:57:183
240946899102,5cyclictest0-21swapper/322:02:173
240946899102,5cyclictest0-21swapper/321:47:213
240946899102,5cyclictest0-21swapper/321:47:213
240946899102,4cyclictest0-21swapper/321:42:023
240946899101,5cyclictest0-21swapper/323:44:583
240946899101,5cyclictest0-21swapper/323:32:163
240946899101,5cyclictest0-21swapper/323:17:173
240946899101,5cyclictest0-21swapper/321:12:193
240946899101,5cyclictest0-21swapper/319:57:213
240946899100,6cyclictest0-21swapper/322:42:163
240946899100,3cyclictest0-21swapper/300:39:593
24094689994,3cyclictest0-21swapper/319:32:173
24094689994,2cyclictest0-21swapper/320:22:223
24094689993,4cyclictest0-21swapper/320:37:173
24094689993,4cyclictest0-21swapper/320:27:163
24094689993,4cyclictest0-21swapper/319:17:153
24094689992,6cyclictest0-21swapper/319:42:173
24094689992,4cyclictest0-21swapper/322:04:583
24094689991,5cyclictest0-21swapper/319:37:273
24094689991,4cyclictest0-21swapper/321:54:453
24094689991,3cyclictest0-21swapper/320:42:153
24094689990,5cyclictest0-21swapper/322:17:173
24094679991,5cyclictest2409562-21grep19:14:432
24094689981,4cyclictest0-21swapper/321:52:003
24094689981,4cyclictest0-21swapper/319:27:173
24094689981,3cyclictest0-21swapper/320:52:173
24094689963,2cyclictest0-21swapper/319:14:433
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional