You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-09 - 05:55
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7.osadl.org (updated Fri May 09, 2025 00:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32014399485,25cyclictest0-21swapper/021:41:170
32014399461,3cyclictest400651-21/usr/sbin/munin22:01:170
32014399431,19cyclictest362745-21ntpq21:16:200
32014599413,6cyclictest171rcu_preempt23:08:102
320144994016,8cyclictest11050irq/107-eth%d21:56:241
320143993910,18cyclictest0-21swapper/022:21:220
320143993824,1cyclictest69-21kswapd021:33:100
32014399371,3cyclictest967-21snmpd21:28:010
32014399370,34cyclictest482223-21ssh23:36:230
32014399370,28cyclictest447711-21ntpq22:56:210
32014399362,30cyclictest0-21swapper/021:11:160
32014399362,29cyclictest967-21snmpd00:41:250
32014399354,25cyclictest473542-21ssh23:26:220
320143993519,2cyclictest0-21swapper/023:08:100
320143993431,3cyclictest0-21swapper/020:26:210
32014399342,26cyclictest0-21swapper/020:46:170
32014399332,28cyclictest0-21swapper/022:43:100
32014399332,1cyclictest522084-21gltestperf00:26:180
32014399330,31cyclictest426865-21ntpq22:31:200
32014399324,23cyclictest346987-21apt-get20:33:080
32014399321,4cyclictest354617-21/usr/sbin/munin20:56:250
32014399320,2cyclictest0-21swapper/022:26:250
32014599312,6cyclictest11050irq/107-eth%d23:41:232
32014399314,22cyclictest502180-21sort00:01:170
32014399312,27cyclictest0-21swapper/021:33:070
32014499306,18cyclictest468409-21/usr/sbin/munin23:21:261
32014399303,19cyclictest464778-21/usr/sbin/munin23:16:160
32014399302,1cyclictest345293-21/usr/sbin/munin20:31:170
32014399297,12cyclictest340623-21if_wlan020:16:170
32014399295,22cyclictest530558-21latency_hist00:38:070
32014399294,23cyclictest487856-21idleruntime-cro23:43:060
32014399293,25cyclictest322341-21fschecks_time19:21:130
32014399293,23cyclictest357676-21ntp_kernel_pll_21:06:210
32014399293,23cyclictest357676-21ntp_kernel_pll_21:06:210
32014399292,2cyclictest508462-21ls00:08:070
32014399292,25cyclictest339423-21grep20:11:230
32014399291,2cyclictest452461-21grep23:01:250
32014399290,20cyclictest0-21swapper/022:49:370
32014399282,25cyclictest396906-21grep21:56:200
32014399281,4cyclictest496340-21latency_hist23:53:060
32014399281,4cyclictest330686-21sed19:46:170
32014399281,23cyclictest342108-21cut20:21:140
32014399281,17cyclictest335137-21munin-node20:01:130
32014399280,8cyclictest349079-21sed20:41:160
32014599275,17cyclictest397408-21ssh21:56:242
32014599274,19cyclictest469312-21/usr/sbin/munin23:21:262
320145992711,14cyclictest410025-21grep22:11:222
320144992720,6cyclictest525586-21fschecks_time00:31:181
32014399275,13cyclictest320101-21munin-run19:13:060
32014399274,12cyclictest409461-21/usr/sbin/munin22:11:180
320143992723,3cyclictest0-21swapper/021:46:220
32014399271,24cyclictest456502-21/usr/sbin/munin23:06:240
32014399271,24cyclictest405020-21aten_r2power_en22:06:160
32014399271,23cyclictest325742-21grep19:31:170
32014499265,16cyclictest456420-21ntp_states23:06:231
32014399262,2cyclictest0-21swapper/000:16:260
32014399262,23cyclictest413705-21fschecks_count22:16:180
32014399262,22cyclictest334913-21basename19:58:060
32014399262,20cyclictest324141-21grep19:26:180
320143992619,1cyclictest0-21swapper/019:51:190
32014399261,3cyclictest11050irq/107-eth%d23:56:180
32014399254,19cyclictest510283-21cut00:11:190
32014399253,4cyclictest526104-21ntpq00:31:220
32014399253,1cyclictest392781-21grep21:51:200
32014399252,23cyclictest0-21swapper/022:36:200
32014399252,22cyclictest330002-21sendmail19:43:060
32014399252,21cyclictest489750-21aten_r2power_po23:46:160
320143992520,3cyclictest0-21swapper/000:18:350
32014399251,6cyclictest435189-21cut22:41:200
32014399251,23cyclictest468769-21fschecks_time23:21:210
320144992420,2cyclictest348868-21cpuspeed20:41:141
32014399243,1cyclictest338171-21grep20:06:250
32014399241,5cyclictest477669-21grep23:31:210
32014399241,21cyclictest327221-21fschecks_count19:36:170
320145992312,7cyclictest354903-21grep20:56:262
32014499233,13cyclictest111788-21systemd-journal00:23:251
320144992315,4cyclictest0-21swapper/121:01:251
32014399233,19cyclictest366629-21cut21:21:180
32014399231,3cyclictest352397-21sed20:51:150
32014399230,5cyclictest355561-21grep21:01:180
112699230,5rtkit-daemon1008-21mta-sts-daemon00:06:051
320144992218,3cyclictest347331-21grep20:36:141
32014399221,3cyclictest320534-21head19:16:150
32014499218,3cyclictest11050irq/107-eth%d23:41:231
32014499213,3cyclictest11050irq/107-eth%d22:36:181
32014599207,2cyclictest11050irq/107-eth%d21:21:212
32014599204,13cyclictest619-21mta-sts-daemon00:18:352
320145992017,2cyclictest337262-21gltestperf20:06:172
320145992016,3cyclictest336530-21kworker/u8:1+events_unbound20:26:262
32014499205,10cyclictest0-21swapper/123:46:231
32014699193,6cyclictest0-21swapper/322:46:233
32014599193,12cyclictest456438-21ssh23:06:232
32014599192,8cyclictest11050irq/107-eth%d21:38:102
32014599192,11cyclictest343036-21unixbench_multi20:21:212
320145991916,2cyclictest364366-21latency_hist21:18:062
32014599191,4cyclictest11050irq/107-eth%d21:26:222
320145991914,3cyclictest331584-21unixbench_singl19:46:252
32014599191,16cyclictest326645-21grep19:31:252
32014599191,11cyclictest390588-21cat21:48:062
32014499193,13cyclictest393542-21cat21:51:271
320144991914,2cyclictest0-21swapper/122:13:061
32014699183,6cyclictest0-21swapper/321:38:103
32014599186,10cyclictest439395-21ssh22:46:232
32014599185,9cyclictest418849-21switchtime22:21:222
32014599184,10cyclictest1007-21mta-sts-daemon21:28:262
32014599183,13cyclictest346412-21apt-get20:33:082
32014599183,12cyclictest321295-21/usr/sbin/munin19:16:222
32014599182,6cyclictest171rcu_preempt22:31:202
320145991812,4cyclictest498468-21gltestperf23:56:182
32014599180,4cyclictest11050irq/107-eth%d22:42:052
32014499183,12cyclictest514946-21/usr/sbin/munin00:16:281
32014499183,12cyclictest426512-21idleruntime22:31:171
32014499182,10cyclictest447165-21tune2fs22:56:171
32014499182,10cyclictest443337-21/usr/sbin/munin22:51:191
320144991814,3cyclictest436715-21cron22:43:061
320144991811,4cyclictest424268-21latency_hist22:28:061
32014499181,13cyclictest376078-21sed21:31:251
32014499181,10cyclictest11050irq/107-eth%d21:26:261
32014499180,5cyclictest362192-21grep21:16:171
32014599176,6cyclictest377644-21ssh21:33:102
32014599174,9cyclictest348946-21grep20:41:152
32014599172,3cyclictest11050irq/107-eth%d21:52:002
320145991714,2cyclictest333980-21gltestperf19:56:162
320145991710,4cyclictest359904-21diskmemload00:26:162
32014499175,9cyclictest334475-21/usr/sbin/munin19:56:211
32014499173,6cyclictest473164-21fschecks_time23:26:201
32014499173,11cyclictest320724-21fschecks_time19:16:171
320144991715,1cyclictest0-21swapper/123:11:201
320144991711,5cyclictest482058-21ntp_kernel_err23:36:211
32014499171,11cyclictest439016-21/usr/sbin/munin22:46:191
320144991710,3cyclictest350716-21grep20:46:191
32014499170,4cyclictest11050irq/107-eth%d21:23:061
32014699163,5cyclictest0-21swapper/323:41:233
32014699160,9cyclictest0-21swapper/300:41:163
32014599169,5cyclictest327351-21grep19:36:182
32014599168,5cyclictest448262-21/usr/sbin/munin22:56:252
32014599165,7cyclictest444818-21ssh22:52:502
32014599165,6cyclictest430356-21basename22:36:162
32014599164,6cyclictest11050irq/107-eth%d20:01:192
32014599163,9cyclictest11050irq/107-eth%d00:36:212
32014599163,4cyclictest477207-21ssh23:31:192
32014599163,11cyclictest473284-21grep23:26:212
32014599163,11cyclictest357349-21/usr/sbin/munin21:06:182
32014599163,11cyclictest357349-21/usr/sbin/munin21:06:182
32014599163,11cyclictest328712-21aten_r2power_po19:41:132
32014599162,9cyclictest332726-21ntp_offset19:51:192
32014599162,11cyclictest515042-21sh00:16:292
32014599160,9cyclictest405139-21/usr/sbin/munin22:06:172
32014599160,11cyclictest346896-21latency_hist20:33:072
32014499164,8cyclictest532793-21ntpq00:41:251
32014499164,8cyclictest327327-21cut19:36:171
32014499164,7cyclictest411989-21ssh22:13:311
32014499163,8cyclictest518290-21/usr/sbin/munin00:21:171
320144991612,3cyclictest353895-21fschecks_time20:56:181
32014499161,10cyclictest356859-21/usr/sbin/munin21:06:141
32014499161,10cyclictest356859-21/usr/sbin/munin21:06:141
320144991610,5cyclictest0-21swapper/120:06:211
32014499160,14cyclictest346766-21apt-key20:33:061
112699160,4rtkit-daemon0-21swapper/119:19:061
32014599154,8cyclictest1006-21mta-sts-daemon00:08:132
32014599154,5cyclictest464613-21grep23:16:152
32014599153,7cyclictest111788-21systemd-journal00:03:222
32014599153,3cyclictest451367-21/usr/sbin/munin23:01:162
32014599152,8cyclictest402133-21grep22:01:272
32014599152,11cyclictest494599-21netstat23:51:182
32014599152,11cyclictest490530-21ntpq23:46:222
32014599151,9cyclictest502176-21/usr/sbin/munin00:01:172
32014599151,10cyclictest324522-21/usr/sbin/munin19:26:222
32014499159,5cyclictest0-21swapper/123:51:141
32014499159,4cyclictest464514-21/usr/sbin/munin23:16:141
32014499155,7cyclictest331153-21/usr/sbin/munin19:46:221
32014499154,9cyclictest344145-21/usr/sbin/munin20:26:201
32014499153,9cyclictest323936-21/usr/sbin/munin19:26:171
32014499153,7cyclictest419531-21ssh22:22:071
32014499153,10cyclictest497993-21/usr/sbin/munin23:56:231
32014499153,10cyclictest388320-21fschecks_count21:46:171
32014499152,9cyclictest339105-21/usr/sbin/munin20:11:191
32014499152,10cyclictest340244-21aten_r2power_vo20:16:141
320144991512,2cyclictest1005-21mta-sts-daemon00:01:181
32014499151,10cyclictest529296-21needreboot00:36:201
32014699144,6cyclictest0-21swapper/300:01:273
32014599144,6cyclictest532035-21ssh00:41:182
32014599143,9cyclictest525380-21aten_r2power_po00:31:152
32014599142,8cyclictest352254-21tune2fs20:51:142
32014599142,10cyclictest481342-21/usr/sbin/munin23:36:152
32014599141,8cyclictest422681-21ssh22:26:202
32014599141,12cyclictest414454-21ps22:16:242
32014499144,8cyclictest320240-21cat19:13:061
32014499144,7cyclictest405692-21/usr/sbin/munin22:06:201
32014499144,6cyclictest342650-21/usr/sbin/munin20:21:191
32014499143,9cyclictest377935-21kworker/u8:2+rpciod21:38:101
32014499143,7cyclictest510301-21tune2fs00:11:191
32014499142,8cyclictest400941-21ssh22:01:181
32014499142,7cyclictest325662-21tune2fs19:31:171
32014699134,6cyclictest0-21swapper/321:56:243
32014699134,5cyclictest0-21swapper/300:11:263
32014699133,6cyclictest0-21swapper/323:06:233
32014699132,7cyclictest0-21swapper/323:48:543
32014699132,6cyclictest0-21swapper/323:36:153
32014699131,6cyclictest0-21swapper/322:31:193
32014599134,7cyclictest0-21swapper/221:01:152
32014599133,7cyclictest0-21swapper/220:11:252
32014599131,8cyclictest341017-21wc20:16:212
32014599130,9cyclictest350653-21cut20:46:182
32014599130,4cyclictest171rcu_preempt19:21:132
32014499134,7cyclictest332920-21/usr/sbin/munin19:51:211
32014499134,6cyclictest451783-21/usr/sbin/munin23:01:191
32014499134,6cyclictest0-21swapper/123:33:071
32014499133,7cyclictest380466-21/usr/sbin/munin21:36:241
32014499133,4cyclictest328573-21/usr/sbin/munin19:41:151
32014499130,11cyclictest358496-21/usr/sbin/munin21:11:151
32014699124,5cyclictest0-21swapper/321:46:243
32014699124,5cyclictest0-21swapper/320:41:163
32014699124,4cyclictest0-21swapper/321:01:243
32014699123,5cyclictest0-21swapper/320:56:173
32014699123,5cyclictest0-21swapper/319:41:163
32014699123,4cyclictest0-21swapper/323:31:233
32014699123,3cyclictest0-21swapper/321:29:313
32014699122,7cyclictest0-21swapper/322:26:253
32014699122,6cyclictest0-21swapper/323:08:093
32014699122,5cyclictest0-21swapper/319:56:233
32014699122,3cyclictest0-21swapper/320:01:133
32014699120,7cyclictest0-21swapper/321:11:293
32014599121,7cyclictest358555-21/usr/sbin/munin21:11:152
32014499123,7cyclictest352198-21/usr/sbin/munin20:51:141
32014499123,7cyclictest0-21swapper/120:01:221
32014699116,3cyclictest0-21swapper/322:16:263
32014699114,4cyclictest0-21swapper/323:21:183
32014699114,4cyclictest0-21swapper/321:16:043
32014699113,5cyclictest0-21swapper/323:46:193
32014699113,5cyclictest0-21swapper/319:51:213
32014699113,5cyclictest0-21swapper/300:21:233
32014699113,4cyclictest0-21swapper/322:51:153
32014699113,4cyclictest0-21swapper/300:06:163
32014699113,3cyclictest0-21swapper/323:01:163
32014699112,6cyclictest0-21swapper/321:51:183
32014699112,6cyclictest0-21swapper/321:33:103
32014699112,5cyclictest0-21swapper/322:41:183
32014699112,5cyclictest0-21swapper/322:18:223
32014699112,5cyclictest0-21swapper/319:36:183
32014699112,4cyclictest0-21swapper/319:26:173
32014699112,3cyclictest0-21swapper/322:11:203
32014699111,6cyclictest0-21swapper/322:36:153
32014699111,6cyclictest0-21swapper/321:26:203
32014699105,3cyclictest0-21swapper/321:20:553
32014699104,4cyclictest0-21swapper/300:29:203
32014699104,3cyclictest0-21swapper/322:06:183
32014699104,3cyclictest0-21swapper/319:31:213
32014699104,3cyclictest0-21swapper/300:16:273
32014699103,6cyclictest0-21swapper/320:33:083
32014699103,4cyclictest0-21swapper/323:23:343
32014699103,4cyclictest0-21swapper/320:46:183
32014699103,4cyclictest0-21swapper/320:11:203
32014699103,3cyclictest0-21swapper/323:56:153
32014699102,5cyclictest0-21swapper/323:16:153
32014699102,5cyclictest0-21swapper/321:06:183
32014699102,5cyclictest0-21swapper/321:06:183
32014699102,5cyclictest0-21swapper/300:36:203
32014699102,4cyclictest0-21swapper/320:16:153
32014699102,3cyclictest0-21swapper/319:23:063
32014699101,6cyclictest0-21swapper/320:26:173
32014699101,5cyclictest0-21swapper/322:54:273
32014699101,4cyclictest0-21swapper/320:18:333
32014699100,5cyclictest0-21swapper/320:49:293
3201469993,4cyclictest0-21swapper/320:31:223
3201469992,4cyclictest0-21swapper/300:23:253
3201469991,5cyclictest0-21swapper/321:59:453
3201469991,5cyclictest0-21swapper/320:06:153
3201469990,6cyclictest0-21swapper/319:16:143
3201469990,5cyclictest0-21swapper/319:46:203
3201459982,5cyclictest607-21dbus-daemon19:13:062
3201469950,3cyclictest0-21swapper/319:13:063
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional