You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-04 - 12:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack2slot7.osadl.org (updated Thu Dec 04, 2025 00:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
393561799511,45cyclictest0-21swapper/021:28:100
393561799476,27cyclictest4004017-21apt-get21:46:120
3935618994537,5cyclictest0-21swapper/123:38:111
3935617994518,6cyclictest0-21swapper/000:13:150
3935617994120,5cyclictest4085221-21ssh23:09:580
3935618993820,14cyclictest0-21swapper/120:33:031
393561799382,12cyclictest3984937-21cron21:26:080
393561999376,14cyclictest4027193-21ssh22:09:052
3935617993627,8cyclictest3975517-21diskmemload22:16:010
3935619993512,15cyclictest4155719-21sendmail-msp00:33:132
393561799352,27cyclictest4028988-1kworker/0:2H+mmc_complete22:28:110
393561899341,7cyclictest4088249-21ntpq23:13:121
393561899341,7cyclictest4084755-21ssh23:09:141
393561799343,30cyclictest0-21swapper/000:28:120
3935617993421,2cyclictest0-21swapper/023:49:280
393561899335,23cyclictest4016218-21ntpq21:58:101
393561899332,8cyclictest4138033-21sendmail-msp00:12:351
3935618993318,11cyclictest0-21swapper/122:08:141
393561799331,25cyclictest3994917-21ssh21:36:310
393561899311,24cyclictest3984979-21sendmail-msp21:31:091
393561799318,6cyclictest11050irq/107-eth%d22:51:000
3935617993114,2cyclictest4040709-21ntpq22:23:100
393561899303,6cyclictest4040716-21ssh22:23:101
3935618993015,9cyclictest11050irq/107-eth%d22:16:011
393561899300,9cyclictest3955972-21apt-get20:16:111
3935617993024,4cyclictest0-21swapper/023:30:180
393561799302,11cyclictest4028988-1kworker/0:2H+kblockd00:06:090
393561799301,21cyclictest0-21swapper/023:13:090
393561999294,15cyclictest4126233-21/usr/sbin/munin23:53:102
3935618992910,16cyclictest3960091-21awk20:28:081
393561799292,26cyclictest0-21swapper/020:56:080
393561799291,19cyclictest967-21snmpd22:08:150
393561999284,16cyclictest4100286-21sendmail-msp23:26:102
393561899283,21cyclictest3945538-21sendmail-msp19:48:421
393561799289,10cyclictest11050irq/107-eth%d22:55:310
3935617992823,3cyclictest0-21swapper/023:55:320
3935617992811,15cyclictest0-21swapper/000:33:130
3935617992810,12cyclictest11050irq/107-eth%d23:18:420
393561999276,14cyclictest619-21mta-sts-daemon00:10:342
393561899273,7cyclictest4035598-21ntpq22:18:121
393561899272,8cyclictest4124614-21sh23:51:501
393561899272,3cyclictest3944465-21cut19:43:041
393561899271,5cyclictest4121183-21gltestperf23:48:061
3935618992710,15cyclictest0-21swapper/119:53:051
393561799273,16cyclictest633-21gpm21:52:130
393561799272,17cyclictest0-21swapper/019:43:140
393561899263,14cyclictest1006-21mta-sts-daemon20:48:101
393561899262,8cyclictest259-21jbd2/mmcblk0p2-823:35:191
393561899261,5cyclictest4004146-21wc21:46:091
393561899261,10cyclictest4095465-21cron23:21:091
393561799262,5cyclictest11050irq/107-eth%d23:58:110
3935617992621,4cyclictest4051754-21ssh22:34:360
3935617992616,2cyclictest4074369-21/usr/sbin/munin22:58:140
393561799260,6cyclictest4097269-21cut23:23:070
393561999255,15cyclictest111788-21systemd-journal23:10:482
393561999253,16cyclictest4116910-21ntpq23:43:132
393561999253,16cyclictest4116910-21ntpq23:43:132
393561899254,4cyclictest4133696-21ssh00:01:251
393561899251,5cyclictest4069521-21ssh22:53:111
393561899251,5cyclictest4049756-21grep22:33:061
3935618992511,4cyclictest11050irq/107-eth%d00:06:091
393561799251,4cyclictest3946573-21ntpq19:48:100
393561799251,19cyclictest0-21swapper/021:56:240
393561799251,13cyclictest4166309-21ntpq00:38:130
393561999244,13cyclictest111788-21systemd-journal21:46:112
393561899249,14cyclictest3975458-21unixbench_singl21:13:171
393561899245,18cyclictest0-21swapper/123:43:111
393561899245,18cyclictest0-21swapper/123:43:111
393561899243,5cyclictest4054129-21/usr/sbin/munin22:38:071
393561899243,17cyclictest4004056-21sendmail-msp21:52:281
393561899243,17cyclictest0-21swapper/119:38:111
393561899242,6cyclictest4131030-21/usr/sbin/munin23:58:111
393561899242,5cyclictest3986776-21fschecks_time21:28:061
393561899242,5cyclictest3939492-21cut19:28:041
393561899242,5cyclictest3935576-21munin-run19:16:081
3935618992414,6cyclictest259-21jbd2/mmcblk0p2-821:46:141
393561899240,6cyclictest4169303-21grep00:43:111
393561799241,3cyclictest3977843-21ntp_states21:18:110
393561799241,2cyclictest4168948-21head00:43:070
393561999239,2cyclictest0-21swapper/221:58:422
393561999236,13cyclictest111788-21systemd-journal20:48:112
3935619992321,2cyclictest3959073-21sendmail-msp20:30:342
393561899236,16cyclictest3955568-21latency_hist20:16:081
393561899233,5cyclictest0-21swapper/122:03:141
393561899233,3cyclictest4044973-21cut22:28:071
393561899233,3cyclictest259-21jbd2/mmcblk0p2-819:33:061
393561899232,5cyclictest4062355-21sendmail-msp22:48:311
393561899232,19cyclictest4102582-21ssh23:28:111
393561899231,6cyclictest4073666-21grep22:58:061
393561899231,4cyclictest4078193-21cut23:03:061
393561899231,4cyclictest3977251-21fschecks_time21:18:071
393561899231,4cyclictest3972820-21tune2fs21:08:071
393561899230,5cyclictest259-21jbd2/mmcblk0p2-819:26:091
393561799230,21cyclictest3960090-21ntpq20:28:080
393561999223,4cyclictest0-21swapper/200:23:442
393561999223,15cyclictest4121564-21ntpq23:48:102
3935619992212,8cyclictest4011307-21ssh21:53:102
393561899229,11cyclictest0-21swapper/120:38:091
393561899226,15cyclictest3996276-21cut21:38:051
393561899224,3cyclictest0-21swapper/121:23:071
393561899224,16cyclictest3953077-21/usr/sbin/munin20:08:111
393561899223,3cyclictest111788-21systemd-journal00:28:141
393561899223,2cyclictest4161727-21sed00:33:071
393561899222,4cyclictest3949368-21fschecks_time19:58:061
393561899221,7cyclictest3969297-21/usr/sbin/munin20:58:051
393561899221,5cyclictest4149483-21/usr/sbin/munin00:18:131
393561899221,5cyclictest3971180-21tune2fs21:03:051
393561899221,5cyclictest3936197-21fschecks_time19:18:061
393561899221,5cyclictest0-21swapper/120:43:071
393561899221,4cyclictest4167966-21munin-plugin-st00:41:081
393561799229,3cyclictest4004059-21ssh21:46:080
393561799221,2cyclictest3984979-21sendmail-msp21:33:130
393561799220,21cyclictest0-21swapper/000:18:070
393561999217,9cyclictest111788-21systemd-journal23:11:392
393561999214,13cyclictest4043199-21sendmail-msp22:26:102
393561999214,11cyclictest3975517-21diskmemload21:38:092
393561999212,17cyclictest4097879-21ssh23:23:122
393561999212,10cyclictest58-21kcompactd020:33:032
3935619992114,6cyclictest4138033-21sendmail-msp00:11:152
393561899218,11cyclictest0-21swapper/120:03:041
393561899213,16cyclictest0-21swapper/123:23:101
393561899211,3cyclictest4058921-21/usr/sbin/munin22:43:051
393561899210,4cyclictest111788-21systemd-journal20:26:081
393561799215,11cyclictest3960930-21/usr/sbin/munin20:33:030
393561799213,15cyclictest1006-21mta-sts-daemon19:23:080
3935617992119,1cyclictest4038039-21latency_hist22:21:080
3935617992119,1cyclictest3965656-21sendmail-msp20:48:020
393561799210,20cyclictest4119414-21wc23:46:090
393561799210,20cyclictest4119414-21wc23:46:090
393561799210,20cyclictest4054412-21ssh22:38:050
393561799210,20cyclictest3936746-21/usr/sbin/munin19:18:110
393561999206,11cyclictest0-21swapper/222:18:122
3935619992011,5cyclictest4160012-21latency_hist00:31:092
393561899202,4cyclictest4152758-21/usr/sbin/munin00:23:041
393561899200,5cyclictest3967963-21gltestperf20:53:071
3935617992016,2cyclictest0-21swapper/021:13:100
393561799201,18cyclictest4114511-21cron23:41:080
393561799201,17cyclictest0-21swapper/022:03:000
393561999195,4cyclictest11050irq/107-eth%d00:43:072
393561999192,3cyclictest11050irq/107-eth%d22:52:372
3935619991911,4cyclictest0-21swapper/221:18:052
393561799197,3cyclictest4106539-21/usr/sbin/munin23:33:020
393561799195,10cyclictest4078759-21ntpq23:03:100
393561799191,12cyclictest3938942-21sendmail-msp19:28:100
393562199183,8cyclictest0-21swapper/322:09:053
393561999184,7cyclictest4079672-21ssh23:03:422
393561999183,10cyclictest3989949-21ssh21:31:092
393561999182,12cyclictest4149777-21/usr/sbin/munin00:18:182
3935619991812,3cyclictest0-21swapper/221:43:092
3935619991810,6cyclictest259-21jbd2/mmcblk0p2-823:35:522
3935617991814,3cyclictest607-21dbus-daemon00:26:080
393562199173,9cyclictest0-21swapper/323:28:113
393562199172,9cyclictest0-21swapper/322:26:123
393561999174,9cyclictest4065906-21ssh22:49:132
393561999174,11cyclictest3984979-21sendmail-msp21:28:182
393561999173,7cyclictest4052906-21cat22:36:092
393561999173,12cyclictest4092988-21ntpq23:18:092
393561999173,10cyclictest4130844-21ssh23:58:082
393561999172,10cyclictest3938942-21sendmail-msp19:26:542
393562199165,6cyclictest0-21swapper/300:11:133
393562199164,6cyclictest0-21swapper/321:46:123
393562199163,8cyclictest0-21swapper/300:06:093
393562199163,7cyclictest0-21swapper/323:48:103
393561999167,3cyclictest0-21swapper/222:03:042
393561999166,6cyclictest3973320-21ntpq21:08:122
393561999165,6cyclictest762-21in:imuxsock19:48:162
393561999165,4cyclictest111788-21systemd-journal21:13:032
393561999162,12cyclictest4135486-21/usr/sbin/munin00:03:102
393561799162,10cyclictest4060170-21ssh22:43:140
112699160,7rtkit-daemon1008-21mta-sts-daemon19:43:132
393562199154,6cyclictest0-21swapper/300:18:183
393562199154,3cyclictest0-21swapper/322:58:043
393562199153,7cyclictest0-21swapper/320:33:033
393562199152,7cyclictest0-21swapper/323:54:333
393561999152,7cyclictest4111503-21sh23:38:072
393561999152,1cyclictest11050irq/107-eth%d22:23:172
393561999151,7cyclictest3982096-21/usr/sbin/munin21:23:072
3935619991511,3cyclictest1008-21mta-sts-daemon19:38:062
3935619991511,2cyclictest0-21swapper/220:01:082
393561799156,5cyclictest0-21swapper/000:03:110
393561799153,9cyclictest3954315-21fschecks_count20:13:060
393562199145,5cyclictest0-21swapper/322:53:123
393562199145,4cyclictest0-21swapper/322:43:423
393562199145,4cyclictest0-21swapper/322:18:123
393562199143,9cyclictest0-21swapper/300:23:163
393562199143,7cyclictest0-21swapper/300:33:133
393562199143,6cyclictest0-21swapper/322:32:143
393562199143,6cyclictest0-21swapper/319:48:423
393562199143,5cyclictest0-21swapper/322:12:313
393562199142,8cyclictest0-21swapper/323:38:123
393562199142,8cyclictest0-21swapper/323:08:123
393561999142,9cyclictest4029951-21/usr/sbin/munin22:13:092
393561999142,8cyclictest4055381-21xargs22:38:152
393561999141,8cyclictest3972211-21munin-plugin-st21:06:092
393561999141,2cyclictest4166311-21ssh00:38:132
3935619991411,2cyclictest4059254-21fschecks_count22:43:042
393561799145,4cyclictest3973759-21unixbench_multi21:08:170
393561799142,11cyclictest3970080-21/usr/sbin/munin20:58:110
393561799142,10cyclictest3953400-21/usr/sbin/munin20:08:170
393561799141,9cyclictest3943261-21/usr/sbin/munin19:38:090
3935617991411,3cyclictest3949817-21ntp_kernel_err19:58:090
3935617991410,3cyclictest3956290-21fschecks_count20:18:040
393562199134,4cyclictest0-21swapper/323:14:423
393562199133,6cyclictest0-21swapper/323:58:063
393562199133,5cyclictest0-21swapper/320:48:013
393562199133,5cyclictest0-21swapper/319:23:083
393562199132,6cyclictest0-21swapper/300:43:153
393561999133,7cyclictest4073766-21/usr/sbin/munin22:58:062
393561999132,6cyclictest3945538-21sendmail-msp19:53:102
393561999131,9cyclictest3962956-21fschecks_time20:38:062
393561999131,8cyclictest3970675-21latency_hist21:01:082
393561999130,3cyclictest3969134-21latency_hist20:56:082
393561799139,3cyclictest3971626-21ntp_kernel_pll_21:03:090
393561799139,3cyclictest3940954-21tail19:33:040
393561799134,5cyclictest1008-21mta-sts-daemon20:23:070
393561799133,8cyclictest3963589-21/usr/sbin/munin20:38:130
393561799131,9cyclictest3947725-21grep19:53:050
3935617991310,2cyclictest0-21swapper/020:03:160
393562199126,5cyclictest0-21swapper/323:43:073
393562199126,5cyclictest0-21swapper/323:43:073
393562199123,6cyclictest0-21swapper/323:18:423
393562199123,6cyclictest0-21swapper/321:52:283
393562199123,5cyclictest0-21swapper/323:33:103
393562199122,5cyclictest0-21swapper/319:28:113
393562199121,7cyclictest0-21swapper/320:58:113
393562199121,6cyclictest0-21swapper/321:43:063
393562199121,6cyclictest0-21swapper/321:38:103
393562199120,6cyclictest0-21swapper/320:26:483
393561999125,5cyclictest0-21swapper/219:23:042
393561999122,7cyclictest3955365-21/usr/sbin/munin20:13:172
393561999122,5cyclictest3937435-21cat19:21:082
393561799121,7cyclictest607-21dbus-daemon19:16:080
393561799120,8cyclictest0-21swapper/020:43:060
112699120,5rtkit-daemon1007-21mta-sts-daemon19:14:482
393562199115,4cyclictest0-21swapper/321:17:213
393562199114,4cyclictest0-21swapper/323:23:063
393562199113,6cyclictest0-21swapper/321:31:093
393562199113,4cyclictest0-21swapper/321:23:073
393562199113,3cyclictest0-21swapper/322:03:023
393562199113,3cyclictest0-21swapper/321:27:133
393562199113,3cyclictest0-21swapper/319:38:043
393562199112,6cyclictest0-21swapper/319:33:083
393562199112,6cyclictest0-21swapper/300:03:053
393562199112,3cyclictest0-21swapper/322:21:093
393562199111,6cyclictest0-21swapper/322:48:433
393562199111,6cyclictest0-21swapper/320:08:073
393561999118,2cyclictest3956722-21needreboot20:18:062
393561999114,4cyclictest3950703-21/usr/sbin/munin20:03:032
393561999113,6cyclictest3957955-21fschecks_time20:23:082
393561999113,5cyclictest3964883-21/usr/sbin/munin20:43:082
393561999112,6cyclictest3941175-21fschecks_time19:33:062
393561999111,8cyclictest3952649-21cut20:08:072
393562199105,3cyclictest0-21swapper/321:13:103
393562199104,3cyclictest0-21swapper/320:03:113
393562199103,4cyclictest0-21swapper/320:13:153
393562199103,4cyclictest0-21swapper/319:53:073
393562199103,4cyclictest0-21swapper/319:43:053
393562199102,6cyclictest0-21swapper/320:38:083
393562199102,5cyclictest0-21swapper/320:16:113
393562199102,5cyclictest0-21swapper/300:37:143
393562199102,4cyclictest0-21swapper/321:57:533
393562199102,4cyclictest0-21swapper/320:53:113
393562199102,4cyclictest0-21swapper/320:23:063
393562199102,3cyclictest0-21swapper/323:01:233
393562199101,6cyclictest0-21swapper/319:58:093
393562199101,6cyclictest0-21swapper/300:26:103
393562199101,4cyclictest0-21swapper/321:03:033
39356219991,4cyclictest0-21swapper/319:18:043
39356219984,3cyclictest0-21swapper/322:38:063
39356219982,4cyclictest0-21swapper/320:43:153
39356219981,4cyclictest0-21swapper/321:08:043
39356219964,1cyclictest0-21swapper/319:16:083
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional