You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-13 - 02:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7.osadl.org (updated Tue May 13, 2025 00:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
788931993725,10cyclictest930231-21ssh23:06:211
78893099372,24cyclictest878392-21cron22:08:090
78893099352,23cyclictest0-21swapper/021:26:220
78893099342,22cyclictest890453-21/usr/sbin/munin22:21:260
788930993225,1cyclictest0-21swapper/022:16:270
788930993215,4cyclictest952782-21grep23:31:200
788930993215,3cyclictest832204-21ssh21:16:300
788931993125,4cyclictest844946-21fschecks_time21:31:201
788930993117,2cyclictest0-21swapper/022:41:170
788932993020,7cyclictest807889-21fschecks_count20:11:212
78893099305,16cyclictest930299-21fschecks_count23:06:220
78893099294,19cyclictest111788-21systemd-journal00:03:150
788931992817,7cyclictest0-21swapper/100:03:141
78893099284,4cyclictest0-21swapper/022:26:210
78893099283,7cyclictest11050irq/107-eth%d23:58:320
788930992820,7cyclictest0-21swapper/020:26:280
78893099281,13cyclictest0-21swapper/023:01:250
78893099272,23cyclictest0-21swapper/022:31:560
788930992716,1cyclictest0-21swapper/000:41:290
78893099271,24cyclictest917047-21ntpq22:51:230
78893099271,23cyclictest111788-21systemd-journal23:23:240
78893099270,2cyclictest0-21swapper/021:51:150
788931992622,2cyclictest927906-21ssh23:03:101
78893099262,23cyclictest850173-21cat21:36:290
78893099261,24cyclictest0-21swapper/022:54:110
78893099261,17cyclictest912091-21fschecks_time22:46:200
78893099261,17cyclictest0-21swapper/022:36:230
78893299251,21cyclictest1008-21mta-sts-daemon19:31:232
78893099253,13cyclictest872153-21ssh22:01:210
788930992521,3cyclictest970662-21grep23:51:190
78893099251,3cyclictest1001182-21latency_hist00:28:100
788932992417,6cyclictest1002816-21fschecks_count00:31:222
788932992416,5cyclictest903099-21fschecks_time22:36:212
788931992419,2cyclictest0-21swapper/121:23:121
78893099240,16cyclictest0-21swapper/023:41:130
78893299232,15cyclictest841070-21ssh21:26:242
788932992316,4cyclictest844944-21grep21:31:202
78893199233,15cyclictest1007162-21ntp_states00:36:281
78893099237,2cyclictest0-21swapper/021:41:250
788930992319,3cyclictest0-21swapper/020:13:100
788930992316,1cyclictest0-21swapper/023:46:250
788930992315,7cyclictest1002790-21fschecks_count00:31:220
78893099230,18cyclictest987967-21basename00:11:200
788932992213,7cyclictest988343-21gltestperf00:11:222
788932992213,6cyclictest825962-21fschecks_count21:06:202
78893199228,3cyclictest11050irq/107-eth%d21:21:241
78893199221,9cyclictest885084-21aten2.4-expect22:16:191
78893199221,19cyclictest633-21gpm19:21:271
78893099229,7cyclictest0-21swapper/019:13:100
78893099223,18cyclictest0-21swapper/023:21:250
78893099223,12cyclictest0-21swapper/000:16:260
78893099221,21cyclictest0-21swapper/021:46:180
78893099221,18cyclictest0-21swapper/000:18:370
78893299217,10cyclictest1965902-1kworker/2:2H+kblockd00:03:152
78893299215,12cyclictest1005-21mta-sts-daemon22:31:242
78893299212,15cyclictest1005-21mta-sts-daemon22:53:132
788932992110,9cyclictest819449-21fschecks_time20:46:222
788931992118,2cyclictest880968-21gltestperf22:11:221
788931992113,6cyclictest860147-21cron21:48:091
78893299204,11cyclictest948255-21/usr/sbin/munin23:26:202
78893299203,11cyclictest939257-21fschecks_count23:16:232
788932992013,5cyclictest0-21swapper/223:36:252
78893299200,4cyclictest11050irq/107-eth%d22:01:162
788931992015,3cyclictest0-21swapper/122:41:211
78893199200,5cyclictest11050irq/107-eth%d21:36:291
78893099203,8cyclictest802639-21/usr/sbin/munin19:56:150
78893099203,8cyclictest802639-21/usr/sbin/munin19:56:150
78893099202,11cyclictest816156-21fschecks_time20:36:220
788930992011,1cyclictest0-21swapper/021:56:270
78893299192,14cyclictest881440-21ssh22:11:272
788932991915,2cyclictest0-21swapper/222:21:182
788932991914,3cyclictest1011467-21unixbench_multi00:41:302
788932991913,4cyclictest814380-21cpuspeed20:31:202
78893199192,14cyclictest788883-21munin-run19:13:101
78893099196,4cyclictest879538-21sshd22:09:450
78893099191,3cyclictest1007236-21grep00:36:300
78893299187,4cyclictest0-21swapper/223:56:232
78893299183,12cyclictest863325-21find21:51:252
78893299183,11cyclictest1007164-21ssh00:36:282
78893299182,13cyclictest930253-21/usr/sbin/munin23:06:222
788932991816,1cyclictest0-21swapper/223:31:182
788932991815,2cyclictest0-21swapper/221:56:252
788932991813,4cyclictest980502-21unixbench_multi00:01:292
788932991813,2cyclictest1006-21mta-sts-daemon23:21:262
788932991812,2cyclictest935880-21unixbench_singl23:11:302
788932991811,5cyclictest925988-21gltestperf23:01:242
78893199186,9cyclictest903606-21ssh22:36:251
78893199185,9cyclictest865196-21ssh21:53:121
78893199185,9cyclictest855829-21latency_hist21:43:091
78893199183,9cyclictest894065-21ssh22:26:201
788931991815,2cyclictest0-21swapper/120:31:191
788931991812,5cyclictest795249-21ntp_kernel_pll_19:31:231
78893099188,4cyclictest975138-21grep23:56:190
78893099184,13cyclictest817558-21aten2.4-expect20:41:180
78893099184,10cyclictest805338-21/usr/sbin/munin20:01:270
78893099182,10cyclictest794829-21fschecks_time19:31:200
788930991814,2cyclictest812180-21unixbench_multi20:21:280
112699180,3rtkit-daemon1125-21rtkit-daemon21:20:590
78893399172,6cyclictest0-21swapper/320:51:243
78893299174,9cyclictest913783-21ssh22:47:302
78893299172,11cyclictest997309-21ls00:23:102
78893299171,9cyclictest821066-21tune2fs20:51:212
78893199174,6cyclictest988832-21ntpq00:11:271
78893199174,10cyclictest974902-21/usr/sbin/munin23:56:171
78893199172,8cyclictest833278-21ssh21:18:091
788931991714,2cyclictest877343-21grep22:06:281
788931991714,1cyclictest0-21swapper/121:01:181
788931991713,2cyclictest0-21swapper/122:51:261
788931991711,5cyclictest944916-21grep23:21:291
78893199171,14cyclictest919249-21apt-get22:53:121
788931991711,3cyclictest1010398-21grep00:41:211
78893199171,11cyclictest1000045-21/usr/sbin/munin00:26:291
112699170,3rtkit-daemon1125-21rtkit-daemon00:13:251
78893399165,6cyclictest0-21swapper/300:16:213
78893399163,7cyclictest0-21swapper/321:26:243
78893399162,8cyclictest0-21swapper/323:51:263
78893299169,2cyclictest171rcu_preempt00:28:102
78893299164,9cyclictest961762-21ssh23:41:202
78893299162,10cyclictest858546-21/usr/sbin/munin21:46:232
78893299161,5cyclictest909651-21munin-run22:43:092
78893299161,3cyclictest11050irq/107-eth%d21:36:232
788932991612,3cyclictest810527-21unixbench_multi20:16:242
788932991610,5cyclictest0-21swapper/221:16:282
78893299160,12cyclictest970778-21grep23:51:202
78893199166,8cyclictest619-21mta-sts-daemon20:36:221
78893199165,8cyclictest871687-21/usr/sbin/munin22:01:171
78893199164,7cyclictest935638-21/usr/sbin/munin23:11:291
78893199163,9cyclictest912666-21ntp_states22:46:261
78893199163,9cyclictest806293-21tune2fs20:06:191
78893199162,12cyclictest953354-21ssh23:31:261
78893199162,11cyclictest971210-21ntp_kernel_err23:51:231
788931991613,3cyclictest803472-21ntp_kernel_pll_19:56:231
788931991613,3cyclictest803472-21ntp_kernel_pll_19:56:231
788931991611,3cyclictest0-21swapper/119:46:191
78893099164,7cyclictest790739-21awk19:18:100
78893099162,13cyclictest796437-21cut19:36:190
78893099161,9cyclictest0-21swapper/021:13:100
78893099161,8cyclictest823985-21/usr/sbin/munin21:01:160
788930991616,0cyclictest0-21swapper/023:36:260
788930991615,1cyclictest0-21swapper/023:14:380
788930991613,2cyclictest0-21swapper/019:51:290
78893099160,10cyclictest934403-21/usr/sbin/munin23:11:320
78893299159,5cyclictest0-21swapper/219:46:252
78893299153,9cyclictest966251-21/usr/sbin/munin23:46:202
78893299153,10cyclictest918807-21latency_hist22:53:102
78893299152,5cyclictest790648-21awk19:18:102
78893299152,2cyclictest0-21swapper/222:06:232
78893299152,10cyclictest805611-21grep20:01:282
788932991512,2cyclictest0-21swapper/222:26:282
78893299151,12cyclictest813025-21if_end020:26:222
78893299150,2cyclictest885834-21ntpq22:16:252
78893199154,9cyclictest979691-21ssh00:01:211
78893199153,10cyclictest811664-21/usr/sbin/munin20:21:231
78893199153,10cyclictest805619-21grep20:01:281
78893199153,10cyclictest1003465-21rm00:31:281
78893199152,10cyclictest962289-21/usr/sbin/munin23:41:251
78893199152,10cyclictest796440-21grep19:36:191
78893199151,8cyclictest957133-21/usr/sbin/munin23:36:221
788931991512,2cyclictest813838-21unixbench_multi20:26:291
788931991511,3cyclictest967235-21unixbench_multi23:46:281
78893199151,10cyclictest817898-21sed20:41:201
78893199151,10cyclictest794126-21grep19:26:271
78893099156,5cyclictest1005-21mta-sts-daemon20:51:240
78893099151,9cyclictest0-21swapper/021:28:480
788930991512,2cyclictest826458-21ntp_kernel_pll_21:06:240
112699150,2rtkit-daemon1125-21rtkit-daemon20:12:281
112699150,2rtkit-daemon1125-21rtkit-daemon19:27:260
78893399143,7cyclictest0-21swapper/300:03:473
78893299142,6cyclictest993021-21grep00:16:292
78893299141,11cyclictest836639-21sed21:21:292
78893299141,11cyclictest810855-21munin-node20:21:172
78893299140,4cyclictest793246-21sed19:26:192
78893299140,10cyclictest823902-21cat20:58:102
78893299140,10cyclictest796474-21grep19:36:192
78893199144,1cyclictest0-21swapper/122:21:271
78893199143,9cyclictest826237-21uname21:06:221
78893199143,8cyclictest948477-21gltestperf23:26:221
78893199143,8cyclictest809488-21/usr/sbin/munin20:16:161
78893199143,6cyclictest819362-21grep20:46:211
78893199143,5cyclictest828884-21latency_hist21:13:101
78893199142,9cyclictest862221-21aten_r2power_fr21:51:161
78893199142,7cyclictest995360-21/usr/sbin/munin00:21:201
78893099143,9cyclictest799374-21/usr/sbin/munin19:46:170
78893099143,8cyclictest822682-21fschecks_time20:56:170
78893099141,9cyclictest0-21swapper/020:46:300
78893099141,10cyclictest809574-21tune2fs20:16:160
788930991410,3cyclictest0-21swapper/019:18:110
78893399134,5cyclictest0-21swapper/321:51:183
78893399133,7cyclictest0-21swapper/322:01:263
78893399133,7cyclictest0-21swapper/321:41:213
78893399132,6cyclictest0-21swapper/322:16:263
78893399131,7cyclictest0-21swapper/300:36:283
78893399131,6cyclictest0-21swapper/300:21:173
78893399130,7cyclictest0-21swapper/321:16:243
78893299134,8cyclictest791128-21apt-get19:18:112
78893299133,3cyclictest11050irq/107-eth%d21:13:102
78893299132,8cyclictest815954-21aten2.4-expect20:36:202
78893299130,11cyclictest802998-21tune2fs19:56:182
78893299130,11cyclictest802998-21tune2fs19:56:182
78893299130,10cyclictest817781-21grep20:41:202
78893199135,6cyclictest939316-21/usr/sbin/munin23:16:231
78893199133,5cyclictest801542-21/usr/sbin/munin19:51:221
78893199132,9cyclictest898710-21/usr/sbin/munin22:31:201
78893199132,8cyclictest821695-21/usr/sbin/munin20:51:271
78893199131,8cyclictest798026-21fschecks_count19:41:191
78893199131,5cyclictest822422-21aten_r2power_en20:56:151
78893199131,10cyclictest790487-21sed19:16:301
78893099131,9cyclictest815740-21grep20:33:100
78893399124,4cyclictest0-21swapper/322:46:263
78893399124,4cyclictest0-21swapper/321:46:233
78893399123,5cyclictest0-21swapper/323:36:233
78893399123,5cyclictest0-21swapper/323:31:203
78893399123,3cyclictest0-21swapper/300:11:203
78893399122,6cyclictest0-21swapper/323:56:183
78893399122,6cyclictest0-21swapper/322:56:223
78893399122,5cyclictest0-21swapper/323:46:173
78893399122,5cyclictest0-21swapper/319:21:263
78893399121,8cyclictest0-21swapper/300:43:093
78893299125,5cyclictest0-21swapper/219:51:272
78893299124,3cyclictest853661-21grep21:41:202
78893299122,8cyclictest798169-21grep19:41:202
78893299121,6cyclictest806113-21aten_r2power_vo20:06:182
78893099126,1cyclictest0-21swapper/020:06:180
78893099123,6cyclictest1007-21mta-sts-daemon19:41:190
78893399116,3cyclictest0-21swapper/323:11:263
78893399114,5cyclictest0-21swapper/323:41:273
78893399114,5cyclictest0-21swapper/322:41:173
78893399114,4cyclictest0-21swapper/322:51:213
78893399113,4cyclictest0-21swapper/323:26:223
78893399113,4cyclictest0-21swapper/322:36:183
78893399113,4cyclictest0-21swapper/322:06:183
78893399113,3cyclictest0-21swapper/320:56:173
78893399113,3cyclictest0-21swapper/319:16:263
78893399112,6cyclictest0-21swapper/323:06:213
78893399112,5cyclictest0-21swapper/321:21:273
78893399112,5cyclictest0-21swapper/321:11:203
78893399112,5cyclictest0-21swapper/320:06:183
78893399112,4cyclictest0-21swapper/321:36:183
78893399112,4cyclictest0-21swapper/319:31:213
78893399112,3cyclictest0-21swapper/322:21:173
78893399111,7cyclictest0-21swapper/321:01:193
78893399111,6cyclictest0-21swapper/321:06:223
78893399111,5cyclictest0-21swapper/321:31:183
78893399111,4cyclictest0-21swapper/322:30:163
78893299110,9cyclictest824209-21/usr/sbin/munin21:01:172
78893399105,3cyclictest0-21swapper/322:11:213
78893399104,4cyclictest0-21swapper/300:26:203
78893399103,5cyclictest0-21swapper/321:53:123
78893399103,4cyclictest0-21swapper/320:41:193
78893399103,4cyclictest0-21swapper/320:31:203
78893399103,4cyclictest0-21swapper/320:26:293
78893399103,4cyclictest0-21swapper/320:16:213
78893399103,3cyclictest0-21swapper/319:51:263
78893399102,5cyclictest0-21swapper/320:21:183
78893399102,5cyclictest0-21swapper/300:31:193
78893399102,4cyclictest0-21swapper/323:01:243
78893399102,4cyclictest0-21swapper/322:26:183
78893399102,4cyclictest0-21swapper/319:46:193
78893399102,4cyclictest0-21swapper/319:36:193
78893399101,6cyclictest0-21swapper/320:11:233
78893399101,5cyclictest0-21swapper/323:21:193
78893399101,5cyclictest0-21swapper/319:41:193
78893399101,4cyclictest0-21swapper/323:58:323
78893399101,4cyclictest0-21swapper/323:14:573
78893399100,7cyclictest0-21swapper/320:01:233
112699100,1rtkit-daemon0-21swapper/219:10:112
7889339994,3cyclictest0-21swapper/320:46:193
7889339994,2cyclictest0-21swapper/319:56:213
7889339994,2cyclictest0-21swapper/319:56:213
7889339992,3cyclictest0-21swapper/319:26:183
7889339983,3cyclictest0-21swapper/320:36:193
7889339951,2cyclictest0-21swapper/319:13:103
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional