You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-03-25 - 04:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot3.osadl.org (updated Tue Mar 25, 2025 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
400191299130,1cyclictest0-21swapper/323:10:103
400191299120,11cyclictest0-21swapper/320:45:013
400191299120,11cyclictest0-21swapper/320:20:133
400191299120,11cyclictest0-21swapper/319:30:123
400191299120,11cyclictest0-21swapper/319:15:143
400191299119,1cyclictest0-21swapper/320:35:113
4001912991110,0cyclictest0-21swapper/323:45:013
4001912991110,0cyclictest0-21swapper/323:00:213
4001912991110,0cyclictest0-21swapper/322:35:143
4001912991110,0cyclictest0-21swapper/320:30:093
4001912991110,0cyclictest0-21swapper/319:25:103
4001912991110,0cyclictest0-21swapper/300:11:153
400191299110,8cyclictest0-21swapper/322:15:003
400191299110,10cyclictest0-21swapper/323:55:133
400191299110,10cyclictest0-21swapper/320:15:133
400191299110,10cyclictest0-21swapper/300:35:143
400191299110,0cyclictest0-21swapper/323:49:563
400191299110,0cyclictest0-21swapper/321:55:133
400191299110,0cyclictest0-21swapper/320:50:013
4001912991010,0cyclictest0-21swapper/322:50:083
4001912991010,0cyclictest0-21swapper/322:27:493
4001912991010,0cyclictest0-21swapper/322:15:183
4001912991010,0cyclictest0-21swapper/321:00:123
4001912991010,0cyclictest0-21swapper/300:30:143
4001912991010,0cyclictest0-21swapper/300:30:143
400191299100,9cyclictest0-21swapper/322:35:013
400191299100,9cyclictest0-21swapper/320:50:143
400191299100,9cyclictest0-21swapper/300:20:173
40019129999,0cyclictest0-21swapper/323:30:013
40019129999,0cyclictest0-21swapper/322:41:053
40019129990,8cyclictest0-21swapper/323:15:193
40019129990,8cyclictest0-21swapper/319:45:013
40019129990,8cyclictest0-21swapper/319:25:013
40019129988,0cyclictest0-21swapper/323:54:073
40019129988,0cyclictest0-21swapper/322:20:133
40019129980,8cyclictest0-21swapper/319:40:013
40019129977,0cyclictest0-21swapper/323:06:043
40019129977,0cyclictest0-21swapper/322:07:373
40019129977,0cyclictest0-21swapper/321:50:133
40019129977,0cyclictest0-21swapper/321:45:493
40019129977,0cyclictest0-21swapper/321:40:123
40019129977,0cyclictest0-21swapper/321:35:063
40019129977,0cyclictest0-21swapper/300:15:133
40019129976,0cyclictest0-21swapper/320:55:143
3999834271,4sleep30-21swapper/319:05:013
40019129966,0cyclictest0-21swapper/323:39:233
40019129966,0cyclictest0-21swapper/320:05:133
40019129965,0cyclictest0-21swapper/319:50:153
4000529261,0sleep00-21swapper/019:05:180
4040463250,1sleep00-21swapper/020:55:120
40019129955,0cyclictest0-21swapper/322:56:563
40019129955,0cyclictest0-21swapper/322:00:123
40019129955,0cyclictest0-21swapper/321:34:323
40019129955,0cyclictest0-21swapper/321:15:193
40019129955,0cyclictest0-21swapper/319:10:163
40019129955,0cyclictest0-21swapper/300:05:013
40019129951,2cyclictest0-21swapper/323:20:143
40019129950,5cyclictest0-21swapper/319:45:183
4000205251,2sleep20-21swapper/219:05:162
13989850,2rtkit-daemon614-21wpa_supplicant21:43:051
4053801240,3sleep04053984-21sed21:30:150
40019129944,0cyclictest0-21swapper/323:32:483
40019129943,0cyclictest0-21swapper/321:20:153
40019129940,3cyclictest4116532-21chrt00:25:163
40019129940,3cyclictest4109362-21chrt00:06:433
40019129940,3cyclictest4080593-21chrt22:45:143
40019129940,3cyclictest4052488-21chrt21:27:493
40019129940,3cyclictest4046257-21chrt21:10:163
40019129940,3cyclictest4044299-21chrt21:05:063
40019129940,3cyclictest4031659-21chrt20:29:563
40019129940,3cyclictest4025718-21taskset20:10:163
40019129940,3cyclictest4025718-21taskset20:10:163
40019129940,0cyclictest0-21swapper/320:00:183
4001392242,1sleep10-21swapper/119:05:311
13989840,2rtkit-daemon760-21snmpd23:56:541
13989840,2rtkit-daemon760-21snmpd19:55:260
13989840,2rtkit-daemon760-21snmpd00:13:251
13989840,2rtkit-daemon613-21systemd-logind20:43:500
13989840,2rtkit-daemon4094857-21seq23:26:051
13989840,1rtkit-daemon4016701-21ntpq19:45:170
4120475231,1sleep24120646-21python300:35:212
4085589230,1sleep14085617-21apt-get23:00:141
4074978230,2sleep24075081-21open_files22:30:132
4038044230,1sleep14038061-21apt-get20:50:011
40019129930,3cyclictest4019769-21chrt19:55:073
13989830,2rtkit-daemon684-21gmain23:46:231
13989830,2rtkit-daemon4045980-21diskmemload22:05:161
13989830,2rtkit-daemon1399-21sendmail-mta20:09:470
13989830,2rtkit-daemon1-21systemd23:37:371
13989830,2rtkit-daemon1-21systemd00:16:341
13989830,1rtkit-daemon762-21ntpd20:23:210
13989830,1rtkit-daemon762-21ntpd19:19:190
13989830,1rtkit-daemon760-21snmpd00:35:311
13989830,1rtkit-daemon4014562-21irqstats19:40:170
13989830,1rtkit-daemon4010628-21diskstats19:30:140
13989830,1rtkit-daemon4003941-21munin-node23:32:151
13989830,1rtkit-daemon4003941-21munin-node22:51:471
13989830,1rtkit-daemon4003941-21munin-node22:12:251
13989830,1rtkit-daemon331-21plymouthd23:10:381
13989830,1rtkit-daemon331-21plymouthd00:21:591
13989830,1rtkit-daemon331-21plymouthd00:01:441
13989830,1rtkit-daemon1399-21sendmail-mta21:25:030
13989830,1rtkit-daemon1-21systemd23:51:181
13989830,1rtkit-daemon1-21systemd22:45:201
13989830,1rtkit-daemon1-21systemd22:30:051
13989830,1rtkit-daemon1-21systemd22:25:381
13989830,1rtkit-daemon1-21systemd22:20:141
13989830,1rtkit-daemon1-21systemd22:17:531
13989830,1rtkit-daemon1-21systemd22:01:131
13989830,1rtkit-daemon1-21systemd21:53:051
13989830,1rtkit-daemon1-21systemd21:16:510
13989830,1rtkit-daemon1-21systemd20:29:300
13989830,1rtkit-daemon0-21swapper/123:23:491
13989830,0rtkit-daemon0-21swapper/100:06:291
13989830,0rtkit-daemon0-21swapper/020:52:410
4119704220,0sleep00-21swapper/000:35:140
4108152220,0sleep00-21swapper/000:00:200
4083011220,1sleep00-21swapper/022:53:080
4057679220,1sleep24057783-21awk21:40:182
4057426220,0sleep00-21swapper/021:40:160
4040628220,1sleep24040893-21diskstats20:55:152
4016598221,1sleep14016729-21sh19:45:181
13989820,1rtkit-daemon762-21ntpd20:45:010
13989820,1rtkit-daemon760-21snmpd21:37:410
13989820,1rtkit-daemon760-21snmpd20:10:530
13989820,1rtkit-daemon760-21snmpd20:10:530
13989820,1rtkit-daemon6926-21packagekitd00:25:441
13989820,1rtkit-daemon417-21systemd-journal20:30:050
13989820,1rtkit-daemon331-21plymouthd20:15:140
13989820,1rtkit-daemon331-21plymouthd19:36:580
13989820,1rtkit-daemon1-21systemd21:05:400
13989820,1rtkit-daemon1-21systemd20:36:000
13989820,1rtkit-daemon1-21systemd19:54:200
13989820,1rtkit-daemon1-21systemd19:20:340
13989820,0rtkit-daemon4022965-21sed20:00:210
13989820,0rtkit-daemon331-21plymouthd23:05:291
13989820,0rtkit-daemon1-21systemd22:56:251
13989820,0rtkit-daemon0-21swapper/123:40:141
13989820,0rtkit-daemon0-21swapper/123:15:151
13989820,0rtkit-daemon0-21swapper/122:40:041
13989820,0rtkit-daemon0-21swapper/122:35:371
13989820,0rtkit-daemon0-21swapper/121:55:191
13989820,0rtkit-daemon0-21swapper/121:45:291
13989820,0rtkit-daemon0-21swapper/121:39:281
13989820,0rtkit-daemon0-21swapper/100:30:171
13989820,0rtkit-daemon0-21swapper/100:30:171
13989820,0rtkit-daemon0-21swapper/021:20:120
13989820,0rtkit-daemon0-21swapper/021:10:210
13989820,0rtkit-daemon0-21swapper/021:00:240
13989820,0rtkit-daemon0-21swapper/019:25:040
13989820,0rtkit-daemon0-21swapper/019:10:060
4118915210,0sleep00-21swapper/000:32:550
4118915210,0sleep00-21swapper/000:32:550
4117316210,0sleep20-21swapper/200:30:082
4117316210,0sleep20-21swapper/200:30:082
4116674210,0sleep20-21swapper/200:26:312
4116273210,0sleep00-21swapper/000:25:020
4114440210,0sleep20-21swapper/200:20:122
4113906210,0sleep04113927-21apt-get00:20:020
4112869210,0sleep24112937-21ssh00:15:192
4112095210,0sleep00-21swapper/000:15:130
4111276210,0sleep00-21swapper/000:10:170
4110171210,0sleep20-21swapper/200:10:112
4109521210,0sleep20-21swapper/200:08:072
4108730210,0sleep20-21swapper/200:03:112
4106819210,0sleep00-21swapper/000:00:000
4105023210,0sleep20-21swapper/223:55:142
4103092210,0sleep00-21swapper/023:50:160
4102652210,0sleep20-21swapper/223:50:022
4102473210,1sleep00-21swapper/023:48:280
4101851210,0sleep20-21swapper/223:45:012
4100006210,0sleep20-21swapper/223:40:052
4099247210,0sleep00-21swapper/023:35:390
4097910210,0sleep20-21swapper/223:35:132
4097109210,0sleep20-21swapper/223:30:212
4096686210,0sleep00-21swapper/023:30:190
4093975210,0sleep20-21swapper/223:20:242
4093156210,0sleep00-21swapper/023:20:170
4091916210,0sleep20-21swapper/223:15:522
4091799210,0sleep00-21swapper/023:15:220
4090060210,0sleep00-21swapper/023:12:530
4088000210,0sleep00-21swapper/023:08:050
4087690210,0sleep20-21swapper/223:05:222
4086412210,0sleep00-21swapper/023:00:210
4085622210,0sleep20-21swapper/223:00:152
4084413210,0sleep04084610-21cat22:55:200
4084143210,0sleep20-21swapper/222:55:182
4082180210,0sleep20-21swapper/222:50:142
4081006210,0sleep00-21swapper/022:48:520
4080599210,0sleep20-21swapper/222:45:182
4079150210,0sleep20-21swapper/222:40:172
4077908210,0sleep20-21swapper/222:37:132
4076384210,1sleep00-21swapper/022:35:070
4073808210,0sleep20-21swapper/222:27:522
4073691210,0sleep00-21swapper/022:26:510
4073094210,0sleep00-21swapper/022:23:380
4072729210,0sleep20-21swapper/222:20:242
4070686211,0sleep0171ktimers/022:16:020
4069536210,0sleep20-21swapper/222:15:162
4068949210,0sleep20-21swapper/222:14:082
4068638210,0sleep00-21swapper/022:11:220
4066486210,0sleep00-21swapper/022:05:490
4066460210,0sleep20-21swapper/222:05:352
4064872210,0sleep20-21swapper/222:00:192
4064073210,0sleep00-21swapper/022:00:120
4063358210,1sleep00-21swapper/021:56:130
4061321210,0sleep20-21swapper/221:51:382
4061317210,0sleep00-21swapper/021:51:360
4059303210,0sleep00-21swapper/021:47:160
4054700210,0sleep20-21swapper/221:35:012
4053986210,0sleep10-21swapper/121:30:161
4053560210,0sleep20-21swapper/221:30:132
4052553210,0sleep10-21swapper/121:28:321
4052264210,0sleep20-21swapper/221:25:412
4050461210,0sleep10-21swapper/121:20:141
4050213210,0sleep20-21swapper/221:20:042
4048955210,0sleep10-21swapper/121:15:191
4048454210,0sleep20-21swapper/221:15:162
4046228210,0sleep20-21swapper/221:10:162
4045605210,0sleep10-21swapper/121:05:221
4044569210,0sleep20-21swapper/221:05:142
4040216210,0sleep10-21swapper/120:55:021
4036396210,0sleep10-21swapper/120:40:201
4035481210,0sleep10-21swapper/120:39:571
4034106210,0sleep20-21swapper/220:35:142
4032877210,0sleep10-21swapper/120:30:161
4031907210,0sleep20-21swapper/220:30:092
4031643210,0sleep10-21swapper/120:29:481
4031542210,1sleep20-21swapper/220:28:292
4030268210,0sleep10-21swapper/120:20:201
4028408210,0sleep20-21swapper/220:15:202
4026983210,0sleep20-21swapper/220:12:202
4026983210,0sleep20-21swapper/220:12:202
4026776210,0sleep10-21swapper/120:10:231
4026776210,0sleep10-21swapper/120:10:231
4024582210,0sleep20-21swapper/220:05:202
4023796210,0sleep10-21swapper/120:05:141
4021858210,0sleep20-21swapper/220:00:152
4021738210,0sleep10-21swapper/120:00:141
4021217210,0sleep10-21swapper/119:57:101
4018052210,0sleep10-21swapper/119:50:181
4016075210,0sleep20-21swapper/219:45:142
4014478210,0sleep20-21swapper/219:40:182
4013774210,0sleep10-21swapper/119:40:011
4013529210,0sleep10-21swapper/119:36:531
4013073210,0sleep20-21swapper/219:35:182
4010981210,0sleep20-21swapper/219:30:182
4010225210,0sleep10-21swapper/119:30:131
4009709210,0sleep10-21swapper/119:26:561
4008037210,0sleep20-21swapper/219:25:002
4008018210,0sleep20-21swapper/219:24:492
4005399210,0sleep20-21swapper/219:15:212
4004580210,0sleep10-21swapper/119:15:161
4003498210,0sleep20-21swapper/219:12:042
4002159210,0sleep14002425-21cpuspeed_turbos19:10:151
4109177200,0sleep00-21swapper/000:05:050
4100000200,0sleep00-21swapper/023:40:030
4094737200,0sleep20-21swapper/223:25:042
4094735200,0sleep00-21swapper/023:25:020
4088454200,0sleep20-21swapper/223:10:032
4078485200,0sleep00-21swapper/022:40:020
4074290200,0sleep00-21swapper/022:30:030
4061939200,0sleep20-21swapper/221:55:032
4059048200,0sleep20-21swapper/221:45:012
4046208200,0sleep10-21swapper/121:10:031
4042383200,0sleep20-21swapper/221:00:032
4042129200,0sleep10-21swapper/121:00:021
4038538200,0sleep20-21swapper/220:50:022
4037657200,0sleep10-21swapper/120:45:051
4037456200,0sleep20-21swapper/220:45:022
4035489200,0sleep20-21swapper/220:40:022
4029366200,0sleep20-21swapper/220:20:052
4027429200,0sleep10-21swapper/120:15:031
4019763200,0sleep20-21swapper/219:55:032
4017851200,0sleep20-21swapper/219:50:032
4006363200,0sleep10-21swapper/119:20:041
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional