You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-05 - 02:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot3.osadl.org (updated Mon Jan 05, 2026 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
967180993120,311cyclictest10893162sleep300:06:563
96718099140,12cyclictest0-21swapper/320:20:143
967180991311,1cyclictest0-21swapper/321:00:143
96718099130,12cyclictest0-21swapper/322:35:133
96718099130,11cyclictest0-21swapper/323:40:143
96718099130,11cyclictest0-21swapper/323:05:133
96718099130,11cyclictest0-21swapper/323:00:133
967180991211,0cyclictest0-21swapper/323:25:143
967180991211,0cyclictest0-21swapper/319:15:143
96718099120,9cyclictest0-21swapper/322:45:133
96718099120,11cyclictest0-21swapper/319:30:003
96718099120,11cyclictest0-21swapper/319:25:003
96718099120,11cyclictest0-21swapper/300:00:153
96718099119,1cyclictest0-21swapper/320:10:143
96718099118,1cyclictest0-21swapper/323:30:113
967180991111,0cyclictest0-21swapper/322:50:203
96718099110,10cyclictest0-21swapper/319:55:133
96718099110,10cyclictest0-21swapper/300:35:013
96718099110,0cyclictest0-21swapper/322:15:123
96718099110,0cyclictest0-21swapper/320:00:203
96718099110,0cyclictest0-21swapper/300:15:203
96718099109,0cyclictest0-21swapper/323:13:333
96718099109,0cyclictest0-21swapper/321:20:133
96718099109,0cyclictest0-21swapper/319:30:133
96718099108,1cyclictest0-21swapper/300:20:133
96718099100,9cyclictest0-21swapper/323:55:193
96718099100,10cyclictest0-21swapper/323:45:183
96718099100,0cyclictest0-21swapper/322:00:013
96718099100,0cyclictest0-21swapper/320:30:203
9671809999,0cyclictest0-21swapper/323:20:013
9671809999,0cyclictest0-21swapper/322:40:163
9671809999,0cyclictest0-21swapper/322:25:183
9671809999,0cyclictest0-21swapper/321:45:113
9671809999,0cyclictest0-21swapper/321:25:163
9671809999,0cyclictest0-21swapper/321:10:003
9671809999,0cyclictest0-21swapper/319:40:143
9671809999,0cyclictest0-21swapper/300:35:233
9671809998,0cyclictest0-21swapper/322:10:213
9671809997,1cyclictest0-21swapper/319:45:093
9671809990,8cyclictest0-21swapper/322:05:113
9671809990,8cyclictest0-21swapper/320:05:143
9671809990,0cyclictest0-21swapper/323:50:183
9671809990,0cyclictest0-21swapper/320:40:193
9671809988,0cyclictest0-21swapper/322:30:123
9671809988,0cyclictest0-21swapper/322:20:193
9671809988,0cyclictest0-21swapper/321:15:183
9671809988,0cyclictest0-21swapper/320:18:133
9671809980,0cyclictest0-21swapper/319:35:193
9671809977,0cyclictest0-21swapper/323:20:143
9671809977,0cyclictest0-21swapper/321:50:223
9671809977,0cyclictest0-21swapper/320:47:513
9671809976,0cyclictest0-21swapper/321:35:183
9671809975,1cyclictest0-21swapper/321:10:123
9671809970,6cyclictest0-21swapper/320:50:123
9671809970,5cyclictest0-21swapper/320:25:113
9671809970,0cyclictest0-21swapper/300:25:003
965439271,4sleep30-21swapper/319:05:133
9671809966,0cyclictest0-21swapper/323:00:013
9671809965,0cyclictest0-21swapper/321:30:123
9671809960,1cyclictest0-21swapper/320:55:133
9671809950,5cyclictest0-21swapper/319:51:463
9671809950,4cyclictest0-21swapper/300:10:123
9671809950,3cyclictest0-21swapper/320:35:183
9671809950,3cyclictest0-21swapper/319:11:123
9671809950,0cyclictest0-21swapper/322:00:153
966684250,1sleep20-21swapper/219:05:502
14039850,2rtkit-daemon766-21snmpd19:07:060
9671809940,3cyclictest1075206-21chrt23:35:063
14039840,2rtkit-daemon418-21systemd-journal22:36:271
14039840,2rtkit-daemon1410-21sendmail-mta21:05:291
14039840,1rtkit-daemon772-21lldpd21:48:521
14039840,1rtkit-daemon1-21systemd22:31:571
1075246240,3sleep11075371-21/usr/sbin/munin23:35:121
1049482240,0sleep00-21swapper/022:34:530
1032218240,0sleep10-21swapper/121:50:511
981410230,2sleep2981656-21diskstats19:45:122
9671809930,0cyclictest0-21swapper/321:40:013
965785231,0sleep10-21swapper/119:05:161
14039830,2rtkit-daemon979058-21sendmail19:39:590
14039830,2rtkit-daemon772-21lldpd19:40:480
14039830,2rtkit-daemon766-21snmpd19:29:590
14039830,2rtkit-daemon691-21gmain22:25:051
14039830,2rtkit-daemon622-21wpa_supplicant19:32:290
14039830,2rtkit-daemon418-21systemd-journal20:12:531
14039830,2rtkit-daemon1064228-21perf23:14:511
14039830,1rtkit-daemon969178-21munin-node22:15:081
14039830,1rtkit-daemon969178-21munin-node21:11:521
14039830,1rtkit-daemon969178-21munin-node20:45:221
14039830,1rtkit-daemon969178-21munin-node19:47:570
14039830,1rtkit-daemon769-21ntpd20:15:151
14039830,1rtkit-daemon769-21ntpd19:13:590
14039830,1rtkit-daemon769-21ntpd00:10:511
14039830,1rtkit-daemon766-21snmpd23:20:231
14039830,1rtkit-daemon766-21snmpd23:04:231
14039830,1rtkit-daemon766-21snmpd00:27:281
14039830,1rtkit-daemon691-21gmain19:19:530
14039830,1rtkit-daemon622-21wpa_supplicant21:26:551
14039830,1rtkit-daemon328-21plymouthd23:57:401
14039830,1rtkit-daemon328-21plymouthd22:50:181
14039830,1rtkit-daemon328-21plymouthd21:30:291
14039830,1rtkit-daemon328-21plymouthd21:20:121
14039830,1rtkit-daemon328-21plymouthd21:00:161
14039830,1rtkit-daemon328-21plymouthd20:30:151
14039830,1rtkit-daemon328-21plymouthd20:25:491
14039830,1rtkit-daemon328-21plymouthd00:16:061
14039830,1rtkit-daemon1410-21sendmail-mta22:43:281
14039830,1rtkit-daemon1-21systemd23:54:001
14039830,1rtkit-daemon1-21systemd23:47:131
14039830,1rtkit-daemon1-21systemd23:42:591
14039830,1rtkit-daemon1-21systemd23:30:161
14039830,1rtkit-daemon1-21systemd23:07:521
14039830,1rtkit-daemon1-21systemd22:59:111
14039830,1rtkit-daemon1-21systemd22:13:391
14039830,1rtkit-daemon1-21systemd22:02:521
14039830,1rtkit-daemon1-21systemd21:57:101
14039830,1rtkit-daemon1-21systemd21:40:541
14039830,1rtkit-daemon1-21systemd20:35:551
14039830,1rtkit-daemon1-21systemd20:22:021
14039830,1rtkit-daemon1-21systemd20:00:271
14039830,1rtkit-daemon1-21systemd00:31:331
14039830,1rtkit-daemon1-21systemd00:21:541
14039830,1rtkit-daemon1-21systemd00:05:221
14039830,1rtkit-daemon1100713-21apt-get00:35:151
14039830,1rtkit-daemon1038537-21ssh22:05:571
1085744230,1sleep11085770-21apt-get00:00:141
1075217230,0sleep00-21swapper/023:35:110
1033635230,2sleep01033734-21ntpq21:55:180
1024376230,1sleep01024410-21munin-run21:35:010
1009373230,2sleep11009541-21sensors_temp20:55:191
999744220,1sleep2999845-21proc_pri20:30:192
995102220,1sleep0995348-21diskstats20:20:160
972586220,1sleep2972696-21grep19:20:222
967496220,1sleep1967759-21sh19:10:131
14039820,1rtkit-daemon1-21systemd23:15:181
14039820,0rtkit-daemon328-21plymouthd21:35:081
14039820,0rtkit-daemon328-21plymouthd21:15:051
14039820,0rtkit-daemon328-21plymouthd20:50:051
14039820,0rtkit-daemon328-21plymouthd19:50:010
14039820,0rtkit-daemon328-21plymouthd19:20:140
14039820,0rtkit-daemon0-21swapper/123:25:041
14039820,0rtkit-daemon0-21swapper/122:45:271
14039820,0rtkit-daemon0-21swapper/122:20:191
14039820,0rtkit-daemon0-21swapper/120:40:161
14039820,0rtkit-daemon0-21swapper/120:05:191
14039820,0rtkit-daemon0-21swapper/119:55:231
1102341221,1sleep2451ktimers/200:38:302
1098317220,0sleep00-21swapper/000:29:520
1089671220,1sleep21089689-21munin-run00:10:012
1086176220,1sleep00-21swapper/000:00:180
1085448220,1sleep21085451-40updatedb.mlocat00:00:002
1085087220,1sleep01085091-21ssh23:56:540
1083189220,1sleep21083191-21ssh23:53:362
1069063220,1sleep01069307-21/usr/sbin/munin23:20:160
1051370220,0sleep00-21swapper/022:38:050
1037193220,1sleep21037329-21aten_r1power_vo22:05:132
1036626220,0sleep00-21swapper/022:02:350
1030069220,1sleep00-21swapper/021:45:220
1027843220,1sleep00-21swapper/021:40:210
1012842220,1sleep01013110-21df21:05:190
1007110220,1sleep21007226-21ls20:50:162
999976210,0sleep00-21swapper/020:30:210
997086210,0sleep00-21swapper/020:25:130
994917210,0sleep20-21swapper/220:20:142
992743210,0sleep00-21swapper/020:15:150
991741210,0sleep20-21swapper/220:10:222
990899210,0sleep00-21swapper/020:10:160
990517210,0sleep00-21swapper/020:09:320
986985210,0sleep20-21swapper/220:00:122
985732210,0sleep00-21swapper/019:55:190
984701210,0sleep10-21swapper/119:53:441
983577210,0sleep20-21swapper/219:50:202
982885210,0sleep10-21swapper/119:49:551
979936210,0sleep10-21swapper/119:40:191
979042210,0sleep20-21swapper/219:39:562
978147210,0sleep10-21swapper/119:35:181
975731210,0sleep20-21swapper/219:30:152
975547210,0sleep10-21swapper/119:30:141
974895210,0sleep10-21swapper/119:25:501
974528210,0sleep20-21swapper/219:25:232
968996210,0sleep10-21swapper/119:15:011
1100778210,0sleep00-21swapper/000:35:160
1100311210,0sleep20-21swapper/200:34:022
1098727210,0sleep00-21swapper/000:30:160
1096495210,0sleep20-21swapper/200:25:132
1094277210,0sleep00-21swapper/000:20:150
1094138210,0sleep20-21swapper/200:20:132
1093844210,0sleep20-21swapper/200:19:532
1093842210,0sleep00-21swapper/000:19:500
1091644210,0sleep00-21swapper/000:13:590
1091632210,0sleep20-21swapper/200:13:532
1087925210,0sleep00-21swapper/000:05:140
1086985210,0sleep20-21swapper/200:00:242
1081545210,0sleep00-21swapper/023:50:130
1080594210,0sleep00-21swapper/023:45:210
1080223210,0sleep20-21swapper/223:45:192
1078241210,0sleep00-21swapper/023:40:210
1078011210,0sleep20-21swapper/223:40:192
1075993210,0sleep20-21swapper/223:35:182
1074743210,1sleep00-21swapper/023:33:040
1073978210,0sleep20-21swapper/223:30:182
1072411210,0sleep00-21swapper/023:26:040
1071936210,0sleep20-21swapper/223:25:222
1068936210,1sleep20-21swapper/223:20:132
1067321210,0sleep20-21swapper/223:15:172
1067237210,0sleep00-21swapper/023:15:150
1065177210,0sleep20-21swapper/223:10:212
1064705210,0sleep00-21swapper/023:10:030
1063870210,0sleep00-21swapper/023:07:070
1063168210,0sleep20-21swapper/223:05:212
1061588210,0sleep20-21swapper/223:00:282
1060993210,0sleep00-21swapper/023:00:180
1059628210,0sleep20-21swapper/222:56:522
1058587210,0sleep00-21swapper/022:55:130
1056858210,0sleep00-21swapper/022:50:180
1056585210,0sleep20-21swapper/222:50:162
1055589210,0sleep20-21swapper/222:48:112
1053963210,1sleep00-21swapper/022:45:130
1053541210,0sleep20-21swapper/222:43:342
1051869210,0sleep00-21swapper/022:40:130
1049485210,0sleep20-21swapper/222:34:552
1046873210,0sleep20-21swapper/222:25:252
1045941210,0sleep00-21swapper/022:25:160
1043909210,0sleep00-21swapper/022:20:160
1043549210,0sleep20-21swapper/222:20:142
1041503210,0sleep20-21swapper/222:15:132
1041350210,0sleep00-21swapper/022:15:100
1040723210,0sleep20-21swapper/222:11:452
1039909210,0sleep00-21swapper/022:10:190
1038071210,0sleep00-21swapper/022:05:190
1033388210,0sleep20-21swapper/221:55:162
1031127210,0sleep20-21swapper/221:50:162
1030864210,0sleep00-21swapper/021:50:140
1029737210,0sleep20-21swapper/221:45:192
1027472210,0sleep20-21swapper/221:40:192
1026351210,0sleep20-21swapper/221:39:392
1025596210,0sleep00-21swapper/021:35:200
1022770210,0sleep20-21swapper/221:30:152
1021897210,0sleep20-21swapper/221:25:342
1019136210,0sleep20-21swapper/221:20:182
1018952210,0sleep00-21swapper/021:20:160
1017013210,0sleep00-21swapper/021:15:160
1015033210,0sleep00-21swapper/021:10:150
1012173210,0sleep20-21swapper/221:05:002
1011617210,0sleep00-21swapper/021:00:230
1010241210,0sleep20-21swapper/221:00:012
1008668210,0sleep00-21swapper/020:55:130
1006769210,0sleep00-21swapper/020:50:140
1005716210,0sleep00-21swapper/020:45:180
1003361210,0sleep00-21swapper/020:40:180
1003079210,0sleep20-21swapper/220:40:152
1001346210,0sleep20-21swapper/220:35:152
997073200,0sleep20-21swapper/220:25:032
992702200,0sleep20-21swapper/220:15:022
988683200,0sleep20-21swapper/220:05:012
986973200,0sleep00-21swapper/020:00:030
984804200,0sleep20-21swapper/219:55:012
979307200,0sleep20-21swapper/219:40:042
971382200,0sleep10-21swapper/119:20:021
969435200,0sleep20-21swapper/219:15:022
967059200,0sleep20-21swapper/219:10:022
1049738200,0sleep20-21swapper/222:35:032
1035056200,0sleep20-21swapper/222:00:032
1020568200,0sleep00-21swapper/021:25:040
1016330200,0sleep20-21swapper/221:15:022
1014348200,0sleep20-21swapper/221:10:012
1010500200,0sleep20-21swapper/221:00:052
1004743200,0sleep20-21swapper/220:45:042
1000665200,0sleep00-21swapper/020:35:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional