You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-05 - 04:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack2slot7.osadl.org (updated Mon May 05, 2025 00:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4009119995623,9cyclictest4181275-21awk23:41:170
400911999402,34cyclictest4123700-21cut22:36:170
400911999402,34cyclictest4123700-21cut22:36:170
400911999401,11cyclictest4679-21fschecks_count00:01:150
400911999396,3cyclictest28676-21tune2fs00:31:170
4009119993820,17cyclictest0-21swapper/021:41:180
4009119993818,19cyclictest4025249-21gltestperf20:01:170
4009119993815,3cyclictest0-21swapper/023:11:180
4009119993811,8cyclictest11050irq/107-eth%d23:18:030
400911999371,1cyclictest0-21swapper/000:26:170
400911999363,22cyclictest0-21swapper/021:26:190
400911999351,4cyclictest4189576-21fschecks_time23:51:170
400911999351,29cyclictest0-21swapper/000:16:230
400911999343,9cyclictest4056802-21ssh21:21:230
400911999342,31cyclictest0-21swapper/021:31:180
4009119993421,2cyclictest4142028-21ntpq22:56:220
4009119993415,18cyclictest0-21swapper/019:21:250
4009119993415,18cyclictest0-21swapper/019:21:250
4009121993324,3cyclictest0-21swapper/219:43:052
400911999332,4cyclictest4176864-21ntpq23:36:190
4009119993314,2cyclictest4079429-21unixbench_singl21:46:220
400911999322,2cyclictest4087846-21ssh21:56:180
400911999314,12cyclictest545-21/usr/sbin/munin23:56:210
400911999312,14cyclictest4133268-21ntpq22:46:240
4009121993010,12cyclictest4009082-21munin-run19:13:032
400912099305,12cyclictest4193542-21/usr/sbin/munin23:56:211
4009119993018,1cyclictest0-21swapper/022:01:230
400911999301,23cyclictest4110731-21/usr/sbin/munin22:21:180
400911999295,11cyclictest1007-21mta-sts-daemon22:16:200
400911999295,11cyclictest1007-21mta-sts-daemon22:16:200
400911999293,8cyclictest4019976-21head19:46:160
4009119992917,11cyclictest1125-21rtkit-daemon23:01:180
4009119992914,3cyclictest0-21swapper/021:36:140
400912199282,6cyclictest11050irq/107-eth%d21:26:192
400912099283,20cyclictest4133261-21ssh22:46:241
400911999281,3cyclictest4150498-21memory23:06:170
400911999280,21cyclictest32798-21cat00:36:210
400912199276,7cyclictest28677-21grep00:31:172
400912199272,5cyclictest0-21swapper/221:53:062
4009119992718,3cyclictest4162860-21aten2.4-expect23:21:140
4009119992617,1cyclictest0-21swapper/022:31:160
4009119992616,2cyclictest0-21swapper/023:47:480
400911999261,2cyclictest4172902-21sed23:31:220
4009119992610,12cyclictest35811-21ntpq00:41:220
112699260,3rtkit-daemon1005-21mta-sts-daemon00:21:172
400912199256,13cyclictest4181274-21ntpq23:41:172
400912199255,2cyclictest0-21swapper/223:21:542
4009120992521,3cyclictest11241-21grep00:08:021
400911999258,7cyclictest4051604-21df_inode21:16:160
400911999258,7cyclictest4051604-21df_inode21:16:160
400911999252,20cyclictest0-21swapper/022:08:030
4009119992512,2cyclictest0-21swapper/022:48:280
4009121992412,9cyclictest4136884-21ssh22:51:142
400911999243,14cyclictest605-21avahi-daemon19:13:030
400912199238,14cyclictest4023570-21tune2fs19:56:152
400912099237,10cyclictest4061009-21ntpq21:26:201
400911999232,20cyclictest0-21swapper/022:11:220
400912199224,16cyclictest4074539-21ssh21:41:232
4009121992210,9cyclictest4101172-21tune2fs22:11:162
400912099223,13cyclictest35820-21ntpq00:41:221
400912099222,15cyclictest4073547-21/usr/sbin/munin21:41:241
4009119992214,5cyclictest0-21swapper/000:06:220
400912199219,8cyclictest4022005-21gltestperf19:51:152
400912199213,15cyclictest14221-21ssh00:11:242
400912199211,16cyclictest0-21swapper/221:11:202
400912199210,8cyclictest4154959-21ntpq23:11:212
4009120992117,2cyclictest4168612-21grep23:26:221
4009120992113,4cyclictest4037728-21sh20:38:021
400911999212,18cyclictest0-21swapper/022:27:130
4009119992111,3cyclictest0-21swapper/000:18:180
112699210,1rtkit-daemon0-21swapper/123:35:391
400912199209,6cyclictest4150144-21fschecks_time23:06:152
400912199209,3cyclictest4160928-21ssh23:18:032
400912199202,6cyclictest4123794-21gltestperf22:36:172
400912199202,6cyclictest4123794-21gltestperf22:36:172
4009121992013,3cyclictest4119693-21ntpq22:31:182
400912099205,6cyclictest11050irq/107-eth%d23:06:191
400912099203,11cyclictest4160930-21ls23:18:031
4009120992015,4cyclictest4094352-21grep22:03:031
4009120992015,3cyclictest4013939-21grep19:26:241
4009120992014,4cyclictest4078307-21grep21:46:141
400912099201,14cyclictest1007-21mta-sts-daemon20:01:221
400911999200,16cyclictest4083918-21unixbench_singl21:51:260
400912199194,11cyclictest4167539-21cut23:26:142
4009121991917,1cyclictest351ktimers/223:58:042
400912199191,3cyclictest11050irq/107-eth%d00:15:502
4009121991913,2cyclictest0-21swapper/222:46:242
400912099191,14cyclictest4101214-21fschecks_time22:11:161
400911999195,8cyclictest11050irq/107-eth%d20:51:190
400911999194,11cyclictest1008-21mta-sts-daemon19:31:210
4009119991915,3cyclictest4167229-21/usr/sbin/munin23:26:200
112699190,2rtkit-daemon967-21snmpd19:13:351
112699190,1rtkit-daemon0-21swapper/120:22:341
400912199189,8cyclictest1125-21rtkit-daemon00:26:232
400912199188,8cyclictest4017911-21fschecks_time19:41:142
400912199186,10cyclictest4069183-21aten_r2power_fr21:36:132
400912199182,4cyclictest11050irq/107-eth%d22:01:172
4009121991815,2cyclictest4172939-21unixbench_multi23:31:222
4009121991815,2cyclictest0-21swapper/222:21:122
400912199180,5cyclictest4010215-21ntpq19:16:202
400912199180,4cyclictest4078878-21ntpq21:46:182
400912199180,4cyclictest0-21swapper/223:46:212
400912099185,7cyclictest4052260-21ntp_states21:16:221
400912099185,7cyclictest4052260-21ntp_states21:16:221
400912099183,12cyclictest4047559-21unixbench_singl21:06:241
4009120991813,4cyclictest4016317-21gltestperf19:36:161
4009120991813,3cyclictest4189325-21aten_r2power_po23:51:151
4009120991813,3cyclictest4096743-21grep22:06:151
4009120991812,4cyclictest0-21swapper/100:36:141
4009120991812,1cyclictest11050irq/107-eth%d00:33:031
400912099180,16cyclictest4083250-21ssh21:51:201
400911999187,4cyclictest12799-21/usr/sbin/munin00:11:240
4009119991811,2cyclictest4128935-21mailstats22:41:220
400912199177,7cyclictest4096692-21fschecks_time22:06:152
400912199176,7cyclictest4036697-21fschecks_time20:36:152
400912199173,3cyclictest11050irq/107-eth%d22:56:182
400912199172,9cyclictest4146623-21ssh23:01:212
400912199172,13cyclictest4130267-21idleruntime-cro22:43:022
400912199172,12cyclictest4115402-21proc_pri22:26:202
400912199172,11cyclictest4040962-21unixbench_singl20:46:242
4009121991713,2cyclictest0-21swapper/223:36:202
400912199171,12cyclictest4042545-21sed20:51:232
4009121991710,6cyclictest4193654-21aten2.4-expect23:56:142
4009121991710,5cyclictest35797-21ssh00:41:222
400912099176,8cyclictest4045822-21sed21:01:271
400912099174,9cyclictest4041626-21fschecks_time20:51:151
400912099174,6cyclictest4185189-21fschecks_time23:46:161
400912099172,12cyclictest4106232-21ntpq22:16:201
400912099172,12cyclictest4106232-21ntpq22:16:201
400912099171,3cyclictest0-21swapper/121:56:191
400912099171,12cyclictest4056085-21/usr/sbin/munin21:21:171
4009120991710,5cyclictest0-21swapper/123:21:151
400912099170,15cyclictest4172922-21sed23:31:221
400912099170,14cyclictest4138111-21ssh22:51:241
400911999173,6cyclictest4010271-21/usr/sbin/munin19:16:210
4009119991714,2cyclictest4013978-21unixbench_singl19:26:240
4009119991713,3cyclictest4038248-21fschecks_count20:41:160
112699170,1rtkit-daemon0-21swapper/100:10:321
400912199168,5cyclictest31945-21fschecks_count00:36:132
400912199166,7cyclictest4065392-21/usr/sbin/munin21:31:202
400912199165,9cyclictest0-21swapper/220:11:222
400912199165,10cyclictest4043364-21gltestperf20:56:182
400912199164,8cyclictest4047284-21/usr/sbin/munin21:06:232
400912199162,8cyclictest4056240-21rm21:21:172
400912199162,7cyclictest4033903-21ntpq20:26:222
400912199161,5cyclictest4051815-21sed21:16:172
400912199161,5cyclictest4051815-21sed21:16:172
4009121991613,3cyclictest4016747-21ntp_kernel_pll_19:36:202
4009121991612,3cyclictest4011315-21fschecks_time19:21:172
4009121991612,3cyclictest4011315-21fschecks_time19:21:172
400912199161,13cyclictest4013959-21sed19:26:242
400912199161,12cyclictest4025550-21/usr/sbin/munin20:01:192
400912099166,7cyclictest2641-21apt-get23:58:051
400912099162,3cyclictest4069801-21ssh21:36:171
400912099161,9cyclictest4146624-21/usr/sbin/munin23:01:211
400912099161,9cyclictest4128214-21cut22:41:151
400911999164,4cyclictest4023182-21/usr/sbin/munin19:56:130
400911999163,9cyclictest4044480-21grep20:58:030
400911999163,10cyclictest4017588-21aten2.4-expect19:41:110
400911999162,10cyclictest4016274-21fschecks_time19:36:150
400912299154,6cyclictest0-21swapper/322:51:183
400912299152,8cyclictest0-21swapper/323:26:213
400912299152,8cyclictest0-21swapper/321:26:243
400912299152,7cyclictest0-21swapper/319:56:193
400912299152,7cyclictest0-21swapper/300:06:253
400912199151,4cyclictest0-21swapper/220:41:212
4009121991512,2cyclictest4082913-21gltestperf21:51:182
4009121991512,2cyclictest4027850-21unixbench_singl20:06:272
400912199150,3cyclictest4105440-21aten2.4-expect22:16:152
400912199150,3cyclictest4105440-21aten2.4-expect22:16:152
400912099156,4cyclictest0-21swapper/122:31:221
400912099155,6cyclictest4028619-21/usr/sbin/munin20:11:181
400912099154,8cyclictest4065790-21/usr/sbin/munin21:31:241
400912099154,6cyclictest4030033-21grep20:16:191
400912099152,8cyclictest4034993-21tune2fs20:31:181
400912099152,6cyclictest4049395-21latency_hist21:13:021
400912099152,10cyclictest11050irq/107-eth%d22:26:221
4009120991512,2cyclictest4142581-21unixbench_multi22:56:271
400912099150,12cyclictest4039920-21grep20:46:161
400911999153,9cyclictest4046946-21/usr/sbin/munin21:06:190
400911999151,8cyclictest4021916-21grep19:51:140
112699150,2rtkit-daemon1125-21rtkit-daemon20:14:510
400912299145,6cyclictest0-21swapper/322:11:233
400912299145,6cyclictest0-21swapper/321:41:263
400912299144,6cyclictest0-21swapper/300:41:223
400912299143,9cyclictest0-21swapper/321:53:053
400912299143,7cyclictest0-21swapper/321:51:183
400912299143,6cyclictest0-21swapper/323:16:183
400912299142,9cyclictest0-21swapper/321:36:193
400912299142,7cyclictest0-21swapper/319:26:193
400912299142,5cyclictest0-21swapper/323:21:143
400912299141,7cyclictest0-21swapper/322:46:243
400912299141,6cyclictest0-21swapper/321:21:163
400912199147,6cyclictest4035025-21cut20:31:182
400912199144,6cyclictest4031844-21grep20:21:182
400912199142,9cyclictest9242-21sed00:06:202
400912199141,9cyclictest4014384-21aten2.4-expect19:31:142
400912199140,2cyclictest4190089-21ntpq23:51:212
400912099145,6cyclictest0-21swapper/119:31:241
400912099143,8cyclictest16914-21aten_r2power_fr00:16:131
400912099143,7cyclictest4019550-21apt-get19:43:041
400912099142,9cyclictest607-21dbus-daemon19:43:021
400912099142,9cyclictest4154001-21/usr/sbin/munin23:11:131
400912099142,9cyclictest4011075-21/usr/sbin/munin19:21:151
400912099142,9cyclictest4011075-21/usr/sbin/munin19:21:151
4009120991412,1cyclictest0-21swapper/120:26:181
400912099141,12cyclictest4021935-21grep19:51:141
400912099141,10cyclictest24985-21tune2fs00:26:151
400912099141,10cyclictest111788-21systemd-journal23:43:031
4009120991410,3cyclictest22110-21grep00:21:251
400911999148,3cyclictest191rcuc/020:23:020
400911999143,6cyclictest4044917-21/usr/sbin/munin21:01:200
400911999142,10cyclictest4026651-21aten_r2power_vo20:06:180
400911999141,9cyclictest4036494-21aten2.4-expect20:36:140
400912299133,6cyclictest0-21swapper/323:56:213
400912299133,6cyclictest0-21swapper/300:31:163
400912299133,4cyclictest0-21swapper/321:31:163
400912299132,8cyclictest0-21swapper/323:41:173
400912299132,7cyclictest0-21swapper/322:16:203
400912299132,7cyclictest0-21swapper/322:16:203
400912299132,7cyclictest0-21swapper/320:51:193
400912299132,6cyclictest0-21swapper/323:31:143
400912299131,7cyclictest0-21swapper/323:58:053
400912299131,7cyclictest0-21swapper/320:31:183
400912299131,6cyclictest0-21swapper/321:06:203
400912199136,4cyclictest4044827-21fschecks_count21:01:192
400912199134,6cyclictest4029863-21/usr/sbin/munin20:16:182
400912099133,7cyclictest4043663-21/usr/sbin/munin20:56:201
400912099132,8cyclictest4111315-21grep22:21:221
400912099132,7cyclictest4026904-21gltestperf20:06:201
400912099131,8cyclictest4123708-21fschecks_time22:36:171
400912099131,8cyclictest4123708-21fschecks_time22:36:171
400911999137,4cyclictest0-21swapper/021:11:180
400911999137,1cyclictest4033311-21df20:26:170
400911999135,5cyclictest4039623-21/usr/sbin/munin20:46:130
400911999133,8cyclictest4028115-21/usr/sbin/munin20:11:170
400911999132,10cyclictest4035766-21wc20:31:250
400912299124,6cyclictest0-21swapper/323:51:173
400912299124,3cyclictest0-21swapper/321:46:183
400912299123,7cyclictest0-21swapper/300:11:153
400912299123,6cyclictest0-21swapper/322:01:213
400912299123,6cyclictest0-21swapper/300:36:213
400912299123,5cyclictest0-21swapper/320:46:183
400912299123,3cyclictest0-21swapper/319:46:233
400912299122,6cyclictest0-21swapper/323:06:193
400912299122,5cyclictest0-21swapper/323:11:193
400912299122,5cyclictest0-21swapper/323:01:173
400912299121,7cyclictest0-21swapper/321:16:163
400912299121,7cyclictest0-21swapper/321:16:163
400912099128,3cyclictest4039251-21grep20:41:251
400912299113,5cyclictest0-21swapper/322:56:263
400912299113,5cyclictest0-21swapper/321:01:263
400912299113,4cyclictest0-21swapper/320:06:213
400912299113,4cyclictest0-21swapper/300:15:093
400912299113,3cyclictest0-21swapper/322:38:183
400912299112,6cyclictest0-21swapper/300:21:193
400912299112,5cyclictest0-21swapper/320:41:213
400912299112,5cyclictest0-21swapper/320:36:153
400912299112,5cyclictest0-21swapper/320:26:163
400912299112,5cyclictest0-21swapper/320:21:223
400912299112,4cyclictest0-21swapper/319:16:133
400912299111,5cyclictest0-21swapper/322:23:593
400912299111,5cyclictest0-21swapper/321:11:213
400912299111,5cyclictest0-21swapper/319:41:153
400912099112,6cyclictest4023330-21/usr/sbin/munin19:56:131
112699110,1rtkit-daemon0-21swapper/119:11:191
400912299105,3cyclictest0-21swapper/320:16:243
400912299104,3cyclictest0-21swapper/322:36:173
400912299104,3cyclictest0-21swapper/322:36:173
400912299103,4cyclictest0-21swapper/319:21:223
400912299103,4cyclictest0-21swapper/319:21:223
400912299103,3cyclictest0-21swapper/322:31:123
400912299102,5cyclictest0-21swapper/320:56:213
400912299101,6cyclictest0-21swapper/322:21:123
400912299101,5cyclictest0-21swapper/319:36:133
400912299101,5cyclictest0-21swapper/300:23:033
40091229994,2cyclictest0-21swapper/322:03:103
40091229992,6cyclictest0-21swapper/323:46:143
40091229992,5cyclictest0-21swapper/323:36:153
40091229992,4cyclictest0-21swapper/320:11:173
40091229992,4cyclictest0-21swapper/320:01:153
40091229990,5cyclictest0-21swapper/319:31:183
40091229982,4cyclictest0-21swapper/319:48:053
40091229961,2cyclictest0-21swapper/319:13:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional