You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-12-11 - 13:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7.osadl.org (updated Wed Dec 11, 2024 00:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
267084799453,31cyclictest0-21swapper/022:04:520
2670847994321,2cyclictest2878405-21sed00:19:510
267084799393,24cyclictest0-21swapper/023:34:530
2670847993927,4cyclictest2722387-21grep21:24:440
267084799362,27cyclictest2726802-21memory21:29:470
267084799362,27cyclictest2726802-21memory21:29:470
2670847993523,5cyclictest2869557-21gltestperf00:09:500
267084799350,21cyclictest0-21swapper/022:18:120
267084799342,2cyclictest2760001-21ssh22:09:500
2670847993417,3cyclictest0-21swapper/023:19:440
267084999333,3cyclictest2791685-21ntpq22:44:501
267084799331,24cyclictest2865446-21awk00:04:510
267084799330,26cyclictest0-21swapper/023:29:490
2670847993220,8cyclictest2881842-21fschecks_time00:24:460
267084999313,10cyclictest2819100-21ssh23:14:531
2670849993115,15cyclictest2697447-21grep20:29:551
2670849993111,1cyclictest0-21swapper/122:59:531
267084799311,27cyclictest2846427-21gltestperf23:44:470
267084999306,4cyclictest2852793-21latency_hist23:50:571
267084999304,6cyclictest0-21swapper/123:29:471
2670849993018,9cyclictest2670851-21systemd19:10:561
267084799304,25cyclictest2842131-21/usr/sbin/munin23:39:520
267084799302,5cyclictest2730312-21/usr/sbin/munin21:34:470
267084999294,8cyclictest2888445-21cut00:34:501
267084799290,2cyclictest0-21swapper/022:44:500
267085099283,5cyclictest171rcu_preempt23:49:522
267084999282,9cyclictest2718015-21gltestperf21:19:571
2670849992812,1cyclictest0-21swapper/120:09:481
2670847992815,2cyclictest2799870-21/usr/sbin/munin22:54:530
2670847992814,5cyclictest2764552-21/usr/sbin/munin22:14:530
267084999273,6cyclictest2800234-21grep22:54:471
2670849992718,6cyclictest2774590-21systemd-run22:25:561
2670849992715,11cyclictest2671649-21cpuspeed19:14:441
2670849992714,12cyclictest2878922-21unixbench_multi00:19:551
267084799273,20cyclictest2670848-21gpgv19:10:560
2670847992719,3cyclictest0-21swapper/021:18:090
2670847992717,5cyclictest0-21swapper/023:51:290
2670847992716,1cyclictest2787628-21unixbench-2d22:39:580
267084799271,4cyclictest2772869-21fschecks_time22:24:470
267084999269,2cyclictest0-21swapper/119:49:511
267084999264,5cyclictest2856812-21grep23:54:561
267084999262,5cyclictest2731720-21sed21:34:551
2670849992620,3cyclictest0-21swapper/122:14:491
2670849992611,2cyclictest0-21swapper/100:09:471
267084799269,13cyclictest2747394-21ls21:54:470
267084999253,3cyclictest2846426-21tail23:44:471
2670847992521,2cyclictest0-21swapper/023:49:520
2670847992515,4cyclictest0-21swapper/023:59:430
267084799250,3cyclictest2694484-21aten_r2power_cu20:24:440
267085099247,15cyclictest619-21mta-sts-daemon00:09:502
267084799243,10cyclictest2828964-21sed23:24:520
267084799241,22cyclictest2813617-21aten2.4-expect23:09:430
267084799241,20cyclictest0-21swapper/021:47:380
267085099234,13cyclictest2715529-21ssh21:15:572
267084999238,13cyclictest0-21swapper/100:24:511
267084799231,21cyclictest0-21swapper/021:39:580
2670850992218,3cyclictest2713244-21cut21:14:462
267085099221,16cyclictest2740707-21rm21:45:562
267084999226,2cyclictest11050irq/107-eth%d21:20:591
267084999224,11cyclictest2747725-21ssh21:54:511
267084999222,7cyclictest0-21swapper/122:39:541
267084999221,3cyclictest0-21swapper/123:59:541
267084799221,12cyclictest2809655-21ssh23:04:510
267084799220,22cyclictest0-21swapper/000:14:440
267084799220,18cyclictest0-21swapper/021:59:540
267085099216,8cyclictest171rcu_preempt23:24:462
2670850992115,1cyclictest171rcu_preempt00:24:522
267085099210,2cyclictest171rcu_preempt23:59:512
267084999215,14cyclictest2820839-21sh23:15:571
267084799211,5cyclictest2689951-21tr20:09:480
2670847992115,4cyclictest0-21swapper/023:14:500
267084799211,18cyclictest0-21swapper/021:14:460
267085099201,6cyclictest0-21swapper/221:34:512
2670850992014,4cyclictest0-21swapper/200:34:552
267085099200,4cyclictest171rcu_preempt23:14:522
267084999208,4cyclictest271ktimers/122:29:441
267084999205,4cyclictest2886747-21latency_hist00:30:561
267084999204,8cyclictest2814602-21/usr/sbin/munin23:09:531
267084999204,5cyclictest2739527-21/usr/sbin/munin21:44:561
267084999202,16cyclictest2714955-21munin-run21:15:561
267084799206,7cyclictest2782723-21ssh22:34:540
267084799202,4cyclictest2795855-21ssh22:49:460
267085099195,12cyclictest0-21swapper/223:04:472
267085099194,10cyclictest2726898-21/usr/sbin/munin21:29:482
267085099194,10cyclictest2726898-21/usr/sbin/munin21:29:482
267085099191,12cyclictest2751055-21aten2.4-expect21:59:442
267084999191,13cyclictest2782020-21/usr/sbin/munin22:34:471
267084799192,8cyclictest2892666-21ssh00:39:580
267084799191,16cyclictest0-21swapper/022:29:500
267084799190,19cyclictest0-21swapper/021:44:500
267084799190,18cyclictest2805339-21ssh22:59:520
267085099182,8cyclictest2885167-21fschecks_count00:29:462
267085099182,4cyclictest2864797-21df_inode00:04:452
267085099181,1cyclictest171rcu_preempt22:44:502
2670850991811,5cyclictest0-21swapper/222:29:432
267084999181,3cyclictest2743129-21fschecks_time21:49:481
2670847991816,1cyclictest2884818-21/usr/sbin/munin00:29:530
267085099179,4cyclictest0-21swapper/220:59:472
267085099172,4cyclictest171rcu_preempt22:09:542
2670850991714,2cyclictest2873858-21fschecks_time00:14:472
2670850991713,2cyclictest0-21swapper/223:19:452
267085099171,12cyclictest2781658-21/usr/sbin/munin22:34:472
267084999179,7cyclictest271ktimers/122:09:521
267084999171,3cyclictest11050irq/107-eth%d21:29:531
267084999171,3cyclictest11050irq/107-eth%d21:29:531
2670849991710,5cyclictest2768901-21ntpq22:19:521
267084799175,9cyclictest2672826-21cut19:15:560
267084799174,8cyclictest2683324-21fschecks_time19:49:470
267084799171,4cyclictest2676361-21/usr/sbin/munin19:29:580
2670847991714,2cyclictest0-21swapper/019:24:440
267085299161,8cyclictest0-21swapper/323:49:523
267085099162,11cyclictest2846244-21/usr/sbin/munin23:44:462
2670850991610,4cyclictest2795623-21fschecks_count22:49:452
267085099160,12cyclictest2801254-21sed22:54:562
267084999169,4cyclictest0-21swapper/120:34:451
267084999162,13cyclictest2795633-21tune2fs22:49:451
267084999162,11cyclictest2756524-21unixbench_singl22:04:551
2670849991613,2cyclictest0-21swapper/121:09:461
112699160,3rtkit-daemon1125-21rtkit-daemon19:36:532
267085099159,4cyclictest0-21swapper/223:09:552
267085099159,4cyclictest0-21swapper/221:24:522
267085099156,8cyclictest2769036-21/usr/sbin/munin22:19:532
267085099153,9cyclictest2786576-21tune2fs22:39:482
267085099153,8cyclictest2755799-21/usr/sbin/munin22:04:492
267085099153,10cyclictest2682596-21grep19:44:562
267085099152,11cyclictest2841713-21tune2fs23:39:492
267084999155,9cyclictest2827971-21grep23:24:441
2670849991512,2cyclictest0-21swapper/123:04:571
2670849991511,3cyclictest2703476-21ntp_kernel_pll_20:49:531
2670849991510,4cyclictest0-21swapper/119:39:461
267084799158,4cyclictest0-21swapper/019:35:560
267084799151,5cyclictest2889941-21latency_hist00:35:570
2670847991511,3cyclictest2710547-21grep21:09:560
112699150,2rtkit-daemon1125-21rtkit-daemon19:58:062
112699150,1rtkit-daemon0-21swapper/220:32:252
267085299144,5cyclictest0-21swapper/300:09:503
267085299143,7cyclictest0-21swapper/321:34:473
267085299143,5cyclictest0-21swapper/323:15:573
267085099144,8cyclictest2804690-21/usr/sbin/munin22:59:472
267085099144,6cyclictest2892464-21/usr/sbin/munin00:39:582
267085099144,5cyclictest11050irq/107-eth%d23:50:592
267085099143,7cyclictest2832805-21/usr/sbin/munin23:29:452
267085099143,7cyclictest2734784-21ssh21:39:492
267085099143,10cyclictest0-21swapper/222:14:542
267085099141,8cyclictest2743017-21/usr/sbin/munin21:49:482
267085099141,7cyclictest2877932-21cut00:19:472
267084999149,3cyclictest2695763-21grep20:24:551
267084999143,8cyclictest762-21in:imuxsock23:40:571
267084999143,8cyclictest2874426-21/usr/sbin/munin00:14:521
267084999142,9cyclictest2864911-21cut00:04:461
267084999142,6cyclictest2770098-1kworker/1:1H+kblockd00:40:571
267084999141,6cyclictest2837642-21/usr/sbin/munin23:34:511
2670849991411,2cyclictest1008-21mta-sts-daemon21:39:051
267084999140,11cyclictest2706114-21aten_r2power_vo20:59:451
267084799142,9cyclictest2673138-21aten_r2power_en19:19:430
2670847991411,2cyclictest2685893-21grep19:54:550
267084799141,11cyclictest2694122-21unixbench_multi20:19:550
267084799141,10cyclictest2687661-21grep20:00:560
112699140,1rtkit-daemon0-21swapper/120:13:501
267085299133,6cyclictest0-21swapper/322:24:553
267085299133,5cyclictest0-21swapper/322:09:443
267085299132,6cyclictest0-21swapper/322:59:473
267085099136,5cyclictest2673376-21cut19:19:452
267085099136,4cyclictest2677999-21/usr/sbin/munin19:34:432
267085099135,6cyclictest2670867-21unin-run19:10:562
267085099135,2cyclictest171rcu_preempt22:24:532
267085099133,8cyclictest2685551-21/usr/sbin/munin19:54:542
267085099132,9cyclictest2746869-21/usr/sbin/munin21:54:542
267085099131,11cyclictest633-21gpm20:09:532
2670850991310,3cyclictest2705112-21ntp_kernel_pll_20:54:522
2670850991310,2cyclictest2694145-21grep20:19:552
267084999139,3cyclictest1008-21mta-sts-daemon21:59:431
267084999132,8cyclictest2686758-21if_wlan019:59:471
267084999132,10cyclictest2693150-21fschecks_time20:19:471
267084999130,11cyclictest2688207-21grep20:04:461
267084799132,8cyclictest2708676-21/usr/sbin/munin21:04:540
267084799132,7cyclictest2702620-21grep20:45:560
267084799131,8cyclictest0-21swapper/019:39:560
267084799131,7cyclictest2681367-21head19:44:460
267084799130,8cyclictest2705710-21munin-run20:55:560
267084799130,1cyclictest2696093-21/usr/sbin/munin20:29:490
267085299124,6cyclictest0-21swapper/321:39:483
267085299123,7cyclictest0-21swapper/323:34:463
267085299123,4cyclictest0-21swapper/320:49:543
267085299122,5cyclictest0-21swapper/322:04:473
267085299122,5cyclictest0-21swapper/300:39:483
267085299121,6cyclictest0-21swapper/300:04:513
267085299121,4cyclictest0-21swapper/323:41:523
267085099122,8cyclictest2710598-21grep21:09:562
267085099122,6cyclictest2676011-21/usr/sbin/munin19:24:552
267085099121,8cyclictest2683507-21/usr/sbin/munin19:49:492
267085099120,8cyclictest2837196-21cut23:34:482
267084999122,6cyclictest2674134-21/usr/sbin/munin19:19:531
267084999122,5cyclictest2707912-21fschecks_count21:04:461
267084999121,7cyclictest2705739-21latency_hist20:55:561
267084799128,3cyclictest628-21systemd-logind20:40:570
267084799123,6cyclictest2707198-21/usr/sbin/munin20:59:550
267084799122,9cyclictest2688267-21/usr/sbin/munin20:04:460
267084799122,7cyclictest2698086-21fschecks_time20:34:470
267084799121,7cyclictest2703019-21tune2fs20:49:490
267084799120,2cyclictest2691328-21awk20:14:460
267085299115,3cyclictest0-21swapper/321:20:573
267085299114,4cyclictest0-21swapper/323:51:293
267085299114,4cyclictest0-21swapper/300:34:513
267085299113,6cyclictest0-21swapper/321:59:493
267085299113,4cyclictest0-21swapper/323:39:533
267085299112,6cyclictest0-21swapper/323:14:503
267085299112,4cyclictest0-21swapper/322:14:453
267085299112,4cyclictest0-21swapper/321:44:433
267085299112,4cyclictest0-21swapper/300:19:453
267085299112,3cyclictest0-21swapper/322:54:463
267085299111,7cyclictest0-21swapper/323:24:513
267085299111,7cyclictest0-21swapper/321:14:463
267085299111,5cyclictest0-21swapper/321:51:103
267085099116,4cyclictest0-21swapper/220:49:472
267085099112,8cyclictest2671417-21/usr/sbin/munin19:14:512
267085099112,6cyclictest2708078-21sed21:04:472
267085099112,4cyclictest2699722-21tune2fs20:39:462
267085099111,9cyclictest2701143-21/usr/sbin/munin20:44:442
267085099111,9cyclictest2697498-21munin-run20:30:562
267085099111,8cyclictest2691319-21aten2.4-expect20:14:462
267085099111,7cyclictest2689276-21idleruntime-cro20:05:562
267085099111,2cyclictest171rcu_preempt20:24:472
267084999118,2cyclictest0-21swapper/120:44:541
267084999114,6cyclictest1008-21mta-sts-daemon19:35:571
267084999112,8cyclictest2699678-21/usr/sbin/munin20:39:461
267084999112,5cyclictest2684729-21/usr/sbin/munin19:54:461
112699110,2rtkit-daemon1005-21mta-sts-daemon19:29:271
267085299105,2cyclictest0-21swapper/300:29:463
267085299103,3cyclictest0-21swapper/320:04:533
267085299102,5cyclictest0-21swapper/320:54:453
267085299102,5cyclictest0-21swapper/319:19:463
267085299102,4cyclictest0-21swapper/322:37:013
267085299102,4cyclictest0-21swapper/321:15:573
267085299102,4cyclictest0-21swapper/320:24:443
267085299102,4cyclictest0-21swapper/319:49:513
267085299102,3cyclictest0-21swapper/321:29:483
267085299102,3cyclictest0-21swapper/321:29:483
267085299102,3cyclictest0-21swapper/300:14:443
267085299101,6cyclictest0-21swapper/322:49:223
267085299101,6cyclictest0-21swapper/322:16:383
267085299101,5cyclictest0-21swapper/322:34:473
267085299101,5cyclictest0-21swapper/322:29:483
267085299101,5cyclictest0-21swapper/320:29:523
267085299101,5cyclictest0-21swapper/300:24:433
267085299101,3cyclictest0-21swapper/322:44:503
267085099101,7cyclictest2676832-21sed19:29:482
267084999101,7cyclictest2681565-21/usr/sbin/munin19:44:471
267084999101,6cyclictest2674797-21aten_r2power_en19:24:431
26708529995,2cyclictest0-21swapper/323:59:433
26708529993,4cyclictest0-21swapper/323:28:533
26708529993,4cyclictest0-21swapper/321:09:493
26708529992,4cyclictest0-21swapper/319:39:453
26708529992,3cyclictest0-21swapper/323:09:473
26708529991,6cyclictest0-21swapper/323:03:293
26708529991,4cyclictest0-21swapper/320:59:473
26708529991,4cyclictest0-21swapper/320:19:543
26708529983,2cyclictest0-21swapper/320:34:453
26708529982,5cyclictest0-21swapper/319:54:543
26708529982,4cyclictest0-21swapper/321:49:443
26708529982,4cyclictest0-21swapper/319:34:453
26708529982,3cyclictest0-21swapper/319:29:473
26708529982,3cyclictest0-21swapper/319:10:563
26708529981,4cyclictest0-21swapper/321:04:523
26708529981,4cyclictest0-21swapper/320:14:503
26708529981,3cyclictest0-21swapper/320:09:453
26708529981,3cyclictest0-21swapper/319:24:443
26708529973,2cyclictest0-21swapper/319:10:583
26708529972,4cyclictest0-21swapper/320:39:463
26708529972,3cyclictest0-21swapper/320:44:463
26708529972,3cyclictest0-21swapper/319:44:473
26708529971,3cyclictest0-21swapper/319:59:433
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional