You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-09 - 05:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot3.osadl.org (updated Fri May 09, 2025 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
94146799151,12cyclictest0-21swapper/321:00:133
94146799150,3cyclictest0-21swapper/319:55:123
94146799149,0cyclictest0-21swapper/320:55:013
941467991411,1cyclictest0-21swapper/321:15:133
94146799140,11cyclictest0-21swapper/322:25:143
94146799130,12cyclictest0-21swapper/323:10:123
94146799130,11cyclictest0-21swapper/319:30:133
941467991210,1cyclictest0-21swapper/322:30:123
941467991210,1cyclictest0-21swapper/320:00:113
94146799120,11cyclictest0-21swapper/321:50:023
94146799120,11cyclictest0-21swapper/321:05:133
94146799120,11cyclictest0-21swapper/319:25:193
941467991111,0cyclictest0-21swapper/323:35:203
941467991110,0cyclictest0-21swapper/323:30:173
94146799110,10cyclictest0-21swapper/323:45:143
94146799110,10cyclictest0-21swapper/322:55:133
94146799110,10cyclictest0-21swapper/321:55:013
94146799110,10cyclictest0-21swapper/321:40:193
94146799110,0cyclictest0-21swapper/323:25:223
94146799110,0cyclictest0-21swapper/323:25:013
94146799110,0cyclictest0-21swapper/322:55:013
94146799110,0cyclictest0-21swapper/320:49:553
94146799110,0cyclictest0-21swapper/319:15:123
94146799110,0cyclictest0-21swapper/300:15:203
94146799109,0cyclictest0-21swapper/319:40:003
941467991010,0cyclictest0-21swapper/322:15:193
941467991010,0cyclictest0-21swapper/322:10:223
941467991010,0cyclictest0-21swapper/322:10:013
941467991010,0cyclictest0-21swapper/321:25:013
941467991010,0cyclictest0-21swapper/319:40:163
941467991010,0cyclictest0-21swapper/319:20:153
941467991010,0cyclictest0-21swapper/300:28:213
94146799100,9cyclictest0-21swapper/320:15:173
94146799100,9cyclictest0-21swapper/319:45:193
94146799100,0cyclictest0-21swapper/323:40:203
94146799100,0cyclictest0-21swapper/321:30:143
94146799100,0cyclictest0-21swapper/320:30:133
9414679999,0cyclictest0-21swapper/300:35:223
9414679999,0cyclictest0-21swapper/300:30:233
9414679998,0cyclictest0-21swapper/320:55:143
9414679998,0cyclictest0-21swapper/319:10:113
9414679988,0cyclictest0-21swapper/323:16:423
9414679988,0cyclictest0-21swapper/322:20:143
9414679988,0cyclictest0-21swapper/321:35:123
9414679988,0cyclictest0-21swapper/320:40:113
9414679988,0cyclictest0-21swapper/320:35:013
9414679988,0cyclictest0-21swapper/300:20:383
9414679988,0cyclictest0-21swapper/300:00:003
9414679987,0cyclictest0-21swapper/323:50:183
9414679987,0cyclictest0-21swapper/321:55:313
9414679987,0cyclictest0-21swapper/320:05:203
9414679980,7cyclictest0-21swapper/322:40:013
9414679980,6cyclictest0-21swapper/322:40:133
939505281,4sleep30-21swapper/319:05:133
9414679977,0cyclictest0-21swapper/323:02:203
9414679976,0cyclictest0-21swapper/323:09:563
9414679970,0cyclictest0-21swapper/321:15:003
9414679966,0cyclictest0-21swapper/300:11:203
9414679966,0cyclictest0-21swapper/300:05:183
9414679955,0cyclictest0-21swapper/322:48:023
9414679955,0cyclictest0-21swapper/322:03:233
9414679955,0cyclictest0-21swapper/320:20:113
9414679955,0cyclictest0-21swapper/319:50:373
13989850,2rtkit-daemon0-21swapper/219:05:262
9414679944,0cyclictest0-21swapper/320:25:143
9414679944,0cyclictest0-21swapper/320:10:153
9414679940,3cyclictest1060876-21chrt00:00:223
940822242,1sleep10-21swapper/119:05:551
13989840,2rtkit-daemon762-21ntpd23:36:512
13989840,2rtkit-daemon1-21systemd22:24:412
945758230,2sleep2945948-21sed19:20:002
9414679933,0cyclictest0-21swapper/321:25:073
940253231,1sleep00-21swapper/019:05:170
13989830,2rtkit-daemon943616-21munin-node21:44:172
13989830,2rtkit-daemon943616-21munin-node19:55:012
13989830,2rtkit-daemon811-21udisksd22:47:112
13989830,2rtkit-daemon762-21ntpd19:45:132
13989830,2rtkit-daemon760-21snmpd21:15:042
13989830,2rtkit-daemon760-21snmpd00:20:192
13989830,2rtkit-daemon600-21avahi-daemon20:05:402
13989830,2rtkit-daemon579-21rpcbind20:51:022
13989830,2rtkit-daemon579-21rpcbind20:37:012
13989830,2rtkit-daemon579-21rpcbind19:27:282
13989830,2rtkit-daemon1399-21sendmail-mta20:42:252
13989830,1rtkit-daemon952710-21df19:35:152
13989830,1rtkit-daemon943616-21munin-node21:49:072
13989830,1rtkit-daemon943616-21munin-node00:13:272
13989830,1rtkit-daemon760-21snmpd22:55:342
13989830,1rtkit-daemon760-21snmpd21:56:022
13989830,1rtkit-daemon760-21snmpd20:15:162
13989830,1rtkit-daemon760-21snmpd00:16:502
13989830,1rtkit-daemon614-21wpa_supplicant22:25:322
13989830,1rtkit-daemon614-21wpa_supplicant19:40:132
13989830,1rtkit-daemon417-21systemd-journal21:35:012
13989830,1rtkit-daemon331-21plymouthd23:47:082
13989830,1rtkit-daemon331-21plymouthd19:33:172
13989830,1rtkit-daemon331-21plymouthd19:10:002
13989830,1rtkit-daemon1-21systemd23:59:092
13989830,1rtkit-daemon1-21systemd23:51:092
13989830,1rtkit-daemon1-21systemd23:24:462
13989830,1rtkit-daemon1-21systemd23:17:542
13989830,1rtkit-daemon1-21systemd23:13:042
13989830,1rtkit-daemon1-21systemd23:05:292
13989830,1rtkit-daemon1-21systemd22:43:322
13989830,1rtkit-daemon1-21systemd22:30:562
13989830,1rtkit-daemon1-21systemd22:15:272
13989830,1rtkit-daemon1-21systemd22:11:212
13989830,1rtkit-daemon1-21systemd00:35:422
13989830,1rtkit-daemon1-21systemd00:05:232
13989830,1rtkit-daemon1-21systemd00:05:002
13989830,1rtkit-daemon1012531-21grep22:05:212
1046988230,2sleep21046992-21ssh23:28:392
995429220,1sleep2995545-21grep21:25:242
977207220,1sleep00-21swapper/020:40:120
971591220,1sleep1971878-21df20:25:161
969632220,1sleep1969874-21tr20:20:111
967764220,1sleep0968035-21df_inode20:15:140
955661220,0sleep00-21swapper/019:42:110
951215220,1sleep00-21swapper/019:30:190
13989820,1rtkit-daemon760-21snmpd21:05:392
13989820,1rtkit-daemon760-21snmpd20:45:062
13989820,1rtkit-daemon6926-21packagekitd00:30:172
13989820,1rtkit-daemon579-21rpcbind20:20:302
13989820,1rtkit-daemon331-21plymouthd20:55:492
13989820,1rtkit-daemon1399-21sendmail-mta23:30:042
13989820,1rtkit-daemon1-21systemd21:10:392
13989820,1rtkit-daemon1-21systemd20:30:042
13989820,1rtkit-daemon0-21swapper/221:50:092
13989820,0rtkit-daemon331-21plymouthd21:30:062
13989820,0rtkit-daemon0-21swapper/223:41:292
13989820,0rtkit-daemon0-21swapper/223:00:242
13989820,0rtkit-daemon0-21swapper/222:35:122
13989820,0rtkit-daemon0-21swapper/222:00:212
13989820,0rtkit-daemon0-21swapper/221:20:322
13989820,0rtkit-daemon0-21swapper/221:00:172
13989820,0rtkit-daemon0-21swapper/220:25:062
13989820,0rtkit-daemon0-21swapper/220:10:252
13989820,0rtkit-daemon0-21swapper/220:00:242
13989820,0rtkit-daemon0-21swapper/219:50:042
13989820,0rtkit-daemon0-21swapper/219:20:122
13989820,0rtkit-daemon0-21swapper/200:25:162
1060464220,1sleep01060599-21memory00:00:200
1058111220,1sleep11058301-21awk23:55:161
1052118220,1sleep00-21swapper/023:40:180
1033326220,1sleep00-21swapper/022:55:200
1031516220,1sleep20-21swapper/222:50:222
1031330220,1sleep11031515-21sed22:50:201
1011544220,1sleep01011791-21diskstats22:05:160
1009399220,1sleep01009693-21df22:00:170
1007663220,1sleep01007816-21cat21:55:200
1006730220,0sleep00-21swapper/021:53:200
999097210,0sleep00-21swapper/021:35:150
998021210,1sleep00-21swapper/021:30:420
997467210,0sleep10-21swapper/121:30:191
994713210,0sleep10-21swapper/121:25:191
994684210,0sleep00-21swapper/021:25:180
992698210,0sleep10-21swapper/121:20:151
990432210,0sleep00-21swapper/021:15:010
988695210,0sleep00-21swapper/021:10:130
986781210,0sleep00-21swapper/021:05:120
985835210,0sleep00-21swapper/021:00:200
984873210,0sleep10-21swapper/121:00:131
983833210,0sleep10-21swapper/120:55:221
983035210,0sleep00-21swapper/020:55:170
981313210,0sleep10-21swapper/120:50:121
980782210,0sleep1980894-21latency_hist20:50:001
979152210,0sleep0979288-21cut20:45:150
977236210,0sleep10-21swapper/120:40:131
976053210,0sleep10-21swapper/120:35:161
973735210,0sleep10-21swapper/120:30:151
973461210,0sleep00-21swapper/020:30:150
971485210,0sleep00-21swapper/020:25:150
969536210,0sleep00-21swapper/020:20:060
965703210,0sleep00-21swapper/020:10:130
964988210,0sleep00-21swapper/020:05:210
961968210,0sleep00-21swapper/020:00:130
961247210,0sleep00-21swapper/019:55:200
958127210,0sleep00-21swapper/019:50:130
957763210,1sleep00-21swapper/019:49:400
955880210,0sleep10-21swapper/119:45:011
953651210,0sleep00-21swapper/019:36:120
951819210,0sleep10-21swapper/119:32:121
949054210,0sleep10-21swapper/119:25:191
948264210,0sleep00-21swapper/019:25:140
946115210,0sleep00-21swapper/019:20:110
944957210,0sleep10-21swapper/119:15:191
941986210,0sleep00-21swapper/019:10:140
1076530210,0sleep10-21swapper/100:38:231
1076234210,0sleep00-21swapper/000:35:460
1074366210,0sleep00-21swapper/000:32:390
1072902210,0sleep10-21swapper/100:30:141
1071872210,1sleep00-21swapper/000:26:530
1070436210,0sleep10-21swapper/100:25:151
1069735210,0sleep10-21swapper/100:21:261
1069620210,0sleep00-21swapper/000:20:250
1067545210,0sleep00-21swapper/000:15:410
1065953210,0sleep10-21swapper/100:15:021
1065724210,1sleep00-21swapper/000:13:000
1064936210,0sleep10-21swapper/100:10:211
1063402210,0sleep00-21swapper/000:05:440
1060021210,0sleep10-21swapper/100:00:171
1058604210,0sleep00-21swapper/023:55:190
1057580210,0sleep10-21swapper/123:54:521
1056221210,1sleep00-21swapper/023:50:160
1053817210,0sleep10-21swapper/123:45:171
1051719210,0sleep10-21swapper/123:40:151
1050977210,0sleep00-21swapper/023:36:590
1049475210,0sleep10-21swapper/123:35:081
1048742210,0sleep00-21swapper/023:30:420
1047405210,0sleep10-21swapper/123:30:151
1046042210,0sleep00-21swapper/023:25:210
1045118210,0sleep10-21swapper/123:25:021
1042961210,0sleep10-21swapper/123:20:111
1042691210,0sleep00-21swapper/023:20:020
1042371210,0sleep10-21swapper/123:17:101
1040950210,0sleep00-21swapper/023:15:130
1040362210,1sleep00-21swapper/023:12:530
1038718210,0sleep10-21swapper/123:10:011
1037488210,0sleep00-21swapper/023:05:200
1036437210,0sleep10-21swapper/123:05:021
1036131210,0sleep00-21swapper/023:02:200
1034330210,0sleep10-21swapper/123:00:011
1034217210,0sleep10-21swapper/122:59:021
1030581210,0sleep00-21swapper/022:50:150
1030067210,0sleep10-21swapper/122:49:081
1029863210,0sleep00-21swapper/022:47:190
1027644210,0sleep00-21swapper/022:41:070
1026412210,0sleep10-21swapper/122:40:161
1024892210,0sleep10-21swapper/122:35:191
1024040210,0sleep00-21swapper/022:35:020
1023552210,0sleep10-21swapper/122:31:551
1019981210,0sleep00-21swapper/022:25:130
1019531210,0sleep10-21swapper/122:23:181
1017357210,0sleep00-21swapper/022:20:010
1016849210,0sleep00-21swapper/022:15:340
1015510210,0sleep10-21swapper/122:15:071
1014864210,0sleep00-21swapper/022:11:250
1013910210,0sleep10-21swapper/122:10:171
1011102210,0sleep10-21swapper/122:05:011
1010671210,0sleep10-21swapper/122:01:141
1007818210,0sleep10-21swapper/121:55:211
1006432210,0sleep10-21swapper/121:50:401
1003802210,0sleep00-21swapper/021:45:190
1003443210,0sleep10-21swapper/121:45:171
1002292210,0sleep10-21swapper/121:40:441
1001754210,0sleep01001927-21smartctl21:40:190
1000310210,0sleep10-21swapper/121:35:521
992426200,0sleep00-21swapper/021:20:020
990665200,0sleep10-21swapper/121:15:021
988679200,0sleep10-21swapper/121:10:021
986533200,0sleep10-21swapper/121:05:021
981018200,0sleep00-21swapper/020:50:030
975263200,0sleep00-21swapper/020:35:030
967596200,0sleep10-21swapper/120:15:031
965687200,0sleep10-21swapper/120:10:021
963775200,0sleep10-21swapper/120:05:021
961864200,0sleep10-21swapper/120:00:021
959734200,0sleep10-21swapper/119:55:011
957791200,0sleep10-21swapper/119:50:011
953949200,0sleep10-21swapper/119:40:001
952274200,0sleep10-21swapper/119:35:051
946016200,0sleep10-21swapper/119:20:041
944079200,0sleep00-21swapper/019:15:020
941708200,0sleep10-21swapper/119:10:021
1061798200,0sleep10-21swapper/100:05:011
1053660200,0sleep00-21swapper/023:45:020
1021817200,0sleep00-21swapper/022:30:030
1019963200,0sleep10-21swapper/122:25:031
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional