You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-02-25 - 10:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7.osadl.org (updated Sun Feb 25, 2024 00:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
246389599740,42cyclictest2548719-21/usr/sbin/munin23:15:300
2463896995110,13cyclictest587-21mta-sts-daemon00:35:311
246389599507,34cyclictest587-21mta-sts-daemon23:35:510
246389599483,25cyclictest11050irq/107-eth%d19:10:300
246389599371,22cyclictest2574036-21latency_hist23:55:300
246389599332,1cyclictest0-21swapper/022:27:050
246389599330,24cyclictest0-21swapper/023:23:080
246389599296,6cyclictest11050irq/107-eth%d22:55:310
246389699278,8cyclictest2463859-21munin-run19:10:301
2463896992722,3cyclictest2567580-21munin-plugin-st23:45:301
246389799264,17cyclictest1115-21sendmail-mta00:35:312
246389599240,22cyclictest2498433-21latency_hist21:55:300
112299240,2rtkit-daemon1121-21rtkit-daemon19:13:061
246389699225,12cyclictest1003-21mta-sts-daemon00:10:311
246389599220,17cyclictest0-21swapper/022:07:540
2463896992117,2cyclictest2498244-21cron21:55:301
2463895992113,2cyclictest0-21swapper/023:47:150
112299210,5rtkit-daemon2469942-21diskmemload22:46:502
246389599201,13cyclictest2464388-21munin-run19:20:300
2463897991916,2cyclictest2548706-21cron23:15:302
112299190,2rtkit-daemon1121-21rtkit-daemon21:39:012
246389599185,10cyclictest0-21swapper/000:10:310
246389599184,3cyclictest0-21swapper/021:17:140
246389599182,14cyclictest1002-21mta-sts-daemon23:16:030
246389799171,3cyclictest11050irq/107-eth%d23:35:182
2463897991712,3cyclictest0-21swapper/220:50:312
246389699178,5cyclictest2468427-21idleruntime-cro20:40:301
246389599172,10cyclictest2540514-21ssh23:02:250
2463895991713,3cyclictest2514150-21munin-plugin-st22:20:300
2463895991713,2cyclictest0-21swapper/022:49:580
2463895991711,1cyclictest0-21swapper/000:26:340
246389799164,8cyclictest2579773-21wc00:05:302
246389799164,5cyclictest2482432-21latency_hist21:30:302
246389799162,11cyclictest2577004-21munin-plugin-st00:00:302
2463897991613,2cyclictest2588664-21cron00:25:302
2463897991612,3cyclictest2567698-21latency_hist23:45:302
2463896991613,1cyclictest1000-21mta-sts-daemon21:58:021
246389799154,3cyclictest11050irq/107-eth%d22:32:362
246389699152,9cyclictest2571236-21ssh23:51:031
246389699152,8cyclictest2548729-21idleruntime-cro23:15:301
246389699151,9cyclictest2466403-21cut20:00:291
246389699151,7cyclictest2476321-21latency_hist21:20:301
246389599158,2cyclictest2473085-21sed21:15:300
246389599152,10cyclictest2526814-21latency_hist22:40:300
246389599151,13cyclictest0-21swapper/023:06:410
112299150,1rtkit-daemon0-21swapper/119:54:131
112299150,1rtkit-daemon0-21swapper/119:54:131
112299150,1rtkit-daemon0-21swapper/000:00:590
246389899143,5cyclictest0-21swapper/323:00:303
246389799142,9cyclictest321-21systemd-journal22:05:302
246389699144,7cyclictest2510927-21idleruntime-cro22:15:301
2463896991411,2cyclictest0-21swapper/100:00:301
2463896991410,3cyclictest2526865-21cat22:40:301
246389599148,2cyclictest0-21swapper/023:29:540
246389599144,7cyclictest2561210-21ssh23:35:180
246389599142,6cyclictest2468425-21munin-plugin-st20:40:300
246389599141,8cyclictest0-21swapper/021:36:230
246389599141,8cyclictest0-21swapper/000:06:370
246389599141,3cyclictest2522409-21ssh22:33:330
2463895991411,2cyclictest2464130-21munin-plugin-st19:15:300
246389599141,0cyclictest0-21swapper/022:24:050
112299140,6rtkit-daemon1001-21mta-sts-daemon22:09:272
246389899134,5cyclictest0-21swapper/300:20:303
246389899134,4cyclictest0-21swapper/300:33:343
246389899133,5cyclictest0-21swapper/322:00:293
246389799132,9cyclictest2469595-21grep21:00:302
246389799131,9cyclictest2495078-21munin-run21:50:302
2463897991310,2cyclictest2573890-21munin-plugin-st23:55:302
2463897991310,2cyclictest1002-21mta-sts-daemon22:35:472
246389699136,5cyclictest0-21swapper/121:40:301
246389699134,7cyclictest2467932-21grep20:30:301
246389699133,3cyclictest2588662-21cron00:25:301
246389699132,8cyclictest2536061-21cron22:55:301
246389699132,7cyclictest2570714-21munin-plugin-st23:50:301
2463896991310,2cyclictest1003-21mta-sts-daemon22:45:001
2463896991310,2cyclictest1002-21mta-sts-daemon22:21:131
246389599139,1cyclictest0-21swapper/021:42:060
246389599137,4cyclictest2466630-21latency_hist20:00:300
246389599137,3cyclictest2536821-21sshd22:56:260
246389599131,8cyclictest0-21swapper/023:55:530
246389599131,8cyclictest0-21swapper/023:41:360
246389599131,8cyclictest0-21swapper/022:41:100
246389599131,8cyclictest0-21swapper/022:12:130
246389599131,8cyclictest0-21swapper/022:02:230
246389599131,8cyclictest0-21swapper/021:34:530
246389599131,8cyclictest0-21swapper/021:21:110
246389599131,8cyclictest0-21swapper/000:18:370
2463895991310,2cyclictest0-21swapper/021:30:300
246389599130,10cyclictest2464929-21wc19:30:300
112299130,8rtkit-daemon1000-21mta-sts-daemon22:44:022
246389899123,6cyclictest0-21swapper/322:10:303
246389799129,2cyclictest0-21swapper/221:10:302
246389799128,3cyclictest321-21systemd-journal22:00:302
246389799128,3cyclictest2551867-21sh23:20:302
246389799126,3cyclictest1003-21mta-sts-daemon21:17:382
246389799125,2cyclictest11050irq/107-eth%d21:45:302
246389799122,8cyclictest2582269-21true00:10:302
246389699129,2cyclictest2467677-21sh20:25:301
246389699129,2cyclictest2464643-21cron19:25:291
246389699129,2cyclictest1003-21mta-sts-daemon00:27:551
246389699125,5cyclictest2472949-21munin-plugin-st21:15:291
246389699122,8cyclictest2469329-21grep20:55:301
246389699122,8cyclictest2466918-21cut20:10:301
246389699121,9cyclictest321-21systemd-journal00:20:301
246389699121,8cyclictest2523705-21latency_hist22:35:301
246389699121,8cyclictest2469846-21latency_hist21:05:301
246389699121,8cyclictest2465006-21grep19:30:301
246389699121,3cyclictest11050irq/107-eth%d23:08:121
2463896991210,1cyclictest1001-21mta-sts-daemon21:34:281
246389599122,8cyclictest2467934-21basename20:30:300
246389599122,4cyclictest11050irq/107-eth%d00:40:300
246389599121,7cyclictest0-21swapper/021:59:430
246389599121,7cyclictest0-21swapper/021:47:260
246389599121,7cyclictest0-21swapper/000:31:210
246389599121,7cyclictest0-21swapper/000:24:150
246389599120,8cyclictest2469940-21cron21:10:300
112299120,1rtkit-daemon0-21swapper/122:05:591
112299120,1rtkit-daemon0-21swapper/120:44:361
246389899112,5cyclictest0-21swapper/322:55:313
246389799118,2cyclictest1000-21mta-sts-daemon21:12:402
246389799117,2cyclictest697-21in:imuxsock20:45:302
246389799115,5cyclictest1002-21mta-sts-daemon23:02:272
246389799115,3cyclictest2561665-21ssh23:35:412
246389799115,3cyclictest2508823-21ssh22:11:512
246389799113,7cyclictest587-21mta-sts-daemon21:51:402
246389699119,1cyclictest1002-21mta-sts-daemon22:01:051
246389699119,1cyclictest1001-21mta-sts-daemon21:44:561
246389699118,3cyclictest1003-21mta-sts-daemon23:39:441
246389699118,2cyclictest271ktimers/122:19:371
246389699118,2cyclictest1121-21rtkit-daemon23:03:441
246389699117,3cyclictest1001-21mta-sts-daemon23:29:511
246389699113,6cyclictest2469428-21sh21:00:301
246389699112,7cyclictest2482549-21latency_hist21:30:301
246389699110,9cyclictest2533044-21latency_hist22:50:301
112299110,6rtkit-daemon1000-21mta-sts-daemon22:56:191
112299110,1rtkit-daemon0-21swapper/223:20:352
112299110,1rtkit-daemon0-21swapper/100:34:451
112299110,1rtkit-daemon0-21swapper/019:35:500
246389899103,3cyclictest0-21swapper/323:23:083
246389899103,3cyclictest0-21swapper/323:12:263
246389899103,3cyclictest0-21swapper/322:46:393
246389899102,5cyclictest0-21swapper/323:47:043
246389899102,5cyclictest0-21swapper/300:05:303
246389899102,4cyclictest0-21swapper/321:24:243
246389899102,4cyclictest0-21swapper/319:20:303
246389899102,4cyclictest0-21swapper/300:27:203
246389899101,7cyclictest0-21swapper/321:42:113
246389899101,6cyclictest0-21swapper/321:36:403
246389899101,4cyclictest0-21swapper/321:00:303
246389899100,6cyclictest0-21swapper/323:42:563
246389799108,1cyclictest11050irq/107-eth%d23:27:472
246389799108,1cyclictest1003-21mta-sts-daemon22:53:022
246389799108,1cyclictest1002-21mta-sts-daemon21:22:332
246389799107,2cyclictest321-21systemd-journal21:05:302
246389799106,3cyclictest2589849-21ssh00:28:302
246389799105,4cyclictest2544365-21ssh23:08:332
246389799105,4cyclictest2483095-21ssh21:31:152
246389799105,2cyclictest2511275-21ssh22:15:442
246389799103,6cyclictest2467998-21grep20:30:302
246389799102,7cyclictest2586764-21awk00:20:302
246389799102,6cyclictest2467023-21latency_hist20:10:312
246389799102,4cyclictest1002-21mta-sts-daemon20:55:302
246389799101,8cyclictest2465387-21sh19:40:302
246389799101,7cyclictest2464722-21grep19:25:302
246389799101,6cyclictest2570712-21munin-run23:50:302
246389799100,7cyclictest2592391-21munin-plugin-st00:35:302
246389799100,7cyclictest2465802-21cat19:45:302
246389699108,2cyclictest2549816-21ssh23:17:011
246389699108,2cyclictest1002-21mta-sts-daemon23:21:261
246389699108,1cyclictest11050irq/107-eth%d23:30:461
246389699108,1cyclictest11050irq/107-eth%d00:04:321
246389699108,1cyclictest1002-21mta-sts-daemon22:28:381
246389699108,1cyclictest0-21swapper/121:50:301
246389699102,5cyclictest2466089-21wc19:50:301
246389699101,7cyclictest2479282-21munin-run21:25:301
246389699101,7cyclictest2465595-21cat19:40:301
246389599101,8cyclictest0-21swapper/020:41:250
246389599101,6cyclictest2469812-21latency_hist21:05:300
246389599101,6cyclictest2467322-21latency_hist20:15:300
112299100,3rtkit-daemon1003-21mta-sts-daemon22:30:302
112299100,3rtkit-daemon1003-21mta-sts-daemon19:07:192
24638989993,4cyclictest0-21swapper/322:41:243
24638989993,3cyclictest0-21swapper/323:32:413
24638989993,2cyclictest0-21swapper/323:16:123
24638989992,5cyclictest0-21swapper/300:00:303
24638989992,4cyclictest0-21swapper/321:29:233
24638989992,4cyclictest0-21swapper/321:20:063
24638989992,3cyclictest0-21swapper/323:35:513
24638989992,3cyclictest0-21swapper/322:21:053
24638989992,3cyclictest0-21swapper/322:10:343
24638989992,3cyclictest0-21swapper/321:35:303
24638989992,3cyclictest0-21swapper/300:06:353
24638989991,7cyclictest0-21swapper/300:35:313
24638989991,5cyclictest0-21swapper/320:00:293
24638989991,4cyclictest0-21swapper/323:01:363
24638989991,3cyclictest0-21swapper/321:50:383
24638979997,1cyclictest11050irq/107-eth%d00:10:512
24638979995,3cyclictest2536324-21ssh22:55:352
24638979995,3cyclictest2515017-21ssh22:21:382
24638979995,2cyclictest2465190-21latency_hist19:35:312
24638979992,5cyclictest2466138-21cron19:55:302
24638979992,5cyclictest2466138-21cron19:55:302
24638979992,4cyclictest2468434-21awk20:40:302
24638979992,3cyclictest2466400-21munin-run20:00:292
24638979991,7cyclictest2468244-21latency_hist20:35:302
24638969995,3cyclictest575-21avahi-daemon20:05:301
24638969995,3cyclictest2580136-21rm00:05:511
24638969994,4cyclictest2467270-21latency_hist20:15:301
24638969991,6cyclictest579-21dbus-daemon21:10:301
24638969990,6cyclictest2468304-21latency_hist20:35:301
24638959993,4cyclictest321-21systemd-journal19:45:300
24638959993,4cyclictest2467584-21latency_hist20:20:310
24638959991,5cyclictest2469044-21cat20:50:310
24638959991,5cyclictest2464839-21latency_hist19:25:300
24638989982,5cyclictest0-21swapper/323:50:313
24638989982,3cyclictest0-21swapper/320:20:303
24638989982,3cyclictest0-21swapper/319:15:303
24638989981,4cyclictest0-21swapper/322:01:043
24638989981,4cyclictest0-21swapper/321:46:113
24638989981,4cyclictest0-21swapper/319:30:303
24638989981,3cyclictest0-21swapper/322:35:333
24638979986,1cyclictest11050irq/107-eth%d20:13:252
24638979986,1cyclictest0-21swapper/219:50:302
24638979981,5cyclictest321-21systemd-journal19:20:302
24638979981,5cyclictest2466658-21cron20:05:302
24638979981,4cyclictest2464129-21ls19:15:302
24638979980,7cyclictest2467839-21latency_hist20:25:302
24638979980,6cyclictest2467585-21latency_hist20:20:312
24638969986,1cyclictest0-21swapper/119:35:301
24638969985,2cyclictest970-21snmpd20:17:191
24638969982,3cyclictest2468932-21idleruntime-cro20:50:301
24638959987,1cyclictest11050irq/107-eth%d19:47:350
24638959984,3cyclictest970-21snmpd19:32:460
24638959982,6cyclictest151ktimers/020:23:240
24638959981,6cyclictest2469171-21cron20:55:300
24638959981,5cyclictest2469432-21ls21:00:300
24638959981,5cyclictest2466179-21latency_hist19:55:300
24638959981,5cyclictest2466179-21latency_hist19:55:300
24638959980,7cyclictest2466916-21munin-run20:10:300
24638989973,3cyclictest0-21swapper/321:05:303
24638989973,3cyclictest0-21swapper/319:23:253
24638989972,2cyclictest0-21swapper/320:30:303
24638989971,4cyclictest0-21swapper/322:26:223
24638989971,4cyclictest0-21swapper/322:16:043
24638989971,4cyclictest0-21swapper/320:41:253
24638989971,4cyclictest0-21swapper/300:10:313
24638989971,3cyclictest0-21swapper/322:30:353
24638989971,3cyclictest0-21swapper/320:55:303
24638989971,3cyclictest0-21swapper/320:40:303
24638989971,3cyclictest0-21swapper/320:35:303
24638989970,4cyclictest0-21swapper/323:08:063
24638989970,3cyclictest0-21swapper/320:07:243
24638979971,3cyclictest2464901-21munin-plugin-st19:30:302
24638969973,3cyclictest2464377-21cron19:20:301
24638969971,4cyclictest699-21rs:main1
24638959975,1cyclictest11050irq/107-eth%d20:00:310
24638959974,2cyclictest970-21snmpd20:31:490
24638989964,2cyclictest0-21swapper/321:15:303
24638989961,3cyclictest0-21swapper/300:23:373
24638989960,4cyclictest0-21swapper/319:38:243
24638989960,3cyclictest0-21swapper/323:25:493
24638989960,3cyclictest0-21swapper/319:50:293
24638989952,2cyclictest0-21swapper/320:12:243
24638989951,2cyclictest0-21swapper/320:48:243
24638989951,2cyclictest0-21swapper/319:51:253
24638989951,2cyclictest0-21swapper/319:51:253
24638989951,2cyclictest0-21swapper/319:44:243
24638989951,2cyclictest0-21swapper/319:35:303
24638989950,3cyclictest0-21swapper/320:25:303
24638989950,2cyclictest0-21swapper/321:10:303
24638989942,1cyclictest0-21swapper/319:10:313
24638989940,2cyclictest0-21swapper/320:05:303
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional