You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-24 - 11:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8s.osadl.org (updated Tue Mar 24, 2026 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8688089919950,1991cyclictest9226212sleep319:49:563
8688089917610,1756cyclictest1109366-21sleep22:05:013
10924242560,2sleep20-21swapper/221:50:272
9357032270,1sleep10-21swapper/120:00:011
9694262210,1sleep30-21swapper/320:25:173
86880899181,13cyclictest884101-21taskset19:20:013
86880899181,13cyclictest1012238-21turbostat21:00:003
12861512180,9sleep21286294-21sed00:00:152
86880899177,7cyclictest1040360-21turbostat21:20:003
86880899175,8cyclictest13312242sleep300:30:003
868808991712,3cyclictest9993432sleep320:47:533
86880899171,13cyclictest1170538-21turbostat22:45:003
86880899171,13cyclictest1093538-21taskset21:53:483
86880899166,7cyclictest12933572sleep300:05:133
86880899166,7cyclictest1277700-21sleep23:59:553
86880899166,7cyclictest1053439-21taskset21:25:213
86880899164,8cyclictest9437262sleep320:05:173
868808991613,1cyclictest0-21swapper/300:31:133
86880899161,12cyclictest1269432-21taskset23:48:193
86880899161,12cyclictest1140234-21taskset22:25:143
86880899161,12cyclictest1070982-21taskset21:40:023
86880899161,11cyclictest875201-21turbostat19:15:003
86880899161,11cyclictest1315893-21turbostat00:20:003
86880899161,11cyclictest1086319-21turbostat21:50:003
86880899161,11cyclictest1024976-21turbostat21:10:003
86880899156,7cyclictest1131208-21taskset22:16:553
86880899155,7cyclictest12532472sleep323:35:413
86880899154,8cyclictest10321052sleep321:13:193
868808991513,0cyclictest0-21swapper/300:39:113
868808991512,1cyclictest0-21swapper/323:21:493
868808991512,1cyclictest0-21swapper/320:23:073
86880899151,11cyclictest986650-21taskset20:38:333
86880899151,11cyclictest957548-21taskset20:15:193
86880899151,11cyclictest915806-21taskset19:40:343
86880899151,11cyclictest1292948-21taskset00:04:403
86880899151,11cyclictest1245757-21taskset23:31:073
86880899151,11cyclictest1018244-21taskset21:00:303
86880899151,10cyclictest1301457-21taskset00:10:173
86880899151,10cyclictest1215193-21taskset23:11:093
86880899151,10cyclictest1197059-21taskset23:00:183
86880899145,7cyclictest987458-21taskset20:40:133
86880899141,9cyclictest897081-21chrt19:30:123
86880899141,9cyclictest1255074-21taskset23:40:133
86880899141,9cyclictest1221191-21taskset23:15:183
86880899141,9cyclictest1201528-21taskset23:05:123
86880899141,9cyclictest11708702sleep322:45:153
86880899141,9cyclictest1137433-21taskset22:20:203
86880899141,9cyclictest1117259-21taskset22:10:133
868808991412,0cyclictest0-21swapper/320:04:213
868808991411,1cyclictest0-21swapper/322:50:463
868808991411,1cyclictest0-21swapper/322:50:453
868808991411,1cyclictest0-21swapper/322:09:493
86880899141,10cyclictest954880-21taskset20:14:593
86880899141,10cyclictest935058-21taskset19:55:273
86880899141,10cyclictest928792-21taskset19:51:213
86880899141,10cyclictest909528-21taskset19:37:293
86880899141,10cyclictest890573-21taskset19:25:063
86880899141,10cyclictest1322393-21taskset00:21:323
86880899141,10cyclictest1276300-21taskset23:50:533
86880899141,10cyclictest1232073-21taskset23:25:093
86880899141,10cyclictest1154487-21taskset22:32:513
86880899141,10cyclictest1100791-21taskset21:57:253
86880899141,10cyclictest1077245-21taskset21:41:053
86880899141,10cyclictest1046596-21taskset21:20:553
86880899140,11cyclictest1161866-21taskset22:37:043
10637162141,10sleep01063749-21fschecks_count21:35:130
9538422131,8sleep2953936-21ntpq20:10:212
86880899135,6cyclictest890290-21taskset19:24:423
86880899131,9cyclictest976378-21taskset20:30:193
86880899131,10cyclictest1055819-21taskset21:30:023
86880899131,10cyclictest1005576-21taskset20:51:123
868808991310,1cyclictest0-21swapper/322:55:023
13299732120,8sleep21329955-40updatedb.plocat00:26:142
12401802121,4sleep01240880-21sed23:30:170
12339142120,8sleep21235677-21cut23:25:182
9958082110,2sleep00-21swapper/020:45:190
8841242110,8sleep2883835-21apt-get19:20:052
8625672111,5sleep1862600-21apt-get19:05:131
12082282111,7sleep01024965-21diskmemload23:08:190
11861172112,5sleep21186154-21apt-get22:55:092
11615752110,8sleep21024965-21diskmemload22:36:162
11019992111,5sleep01102036-21apt-get22:00:120
9667782101,5sleep1966822-21ntpq20:20:231
9616802101,5sleep0961676-21apt-get20:20:140
9475422101,5sleep0947593-21ntp_states20:05:220
13377472101,5sleep21337753-21ssh00:31:312
13215292101,5sleep21321610-21ps00:20:242
13149782100,7sleep21314984-21ssh00:17:122
12872462101,6sleep01288670-21kthreadcore00:00:170
12550272100,5sleep11255068-21ssh23:40:131
12084272100,7sleep11208433-21ssh23:08:521
11631622102,5sleep11163184-21apt-get22:40:131
11467762101,2sleep20-21swapper/222:27:382
11172172102,4sleep21117254-21apt-get22:10:132
10482992101,4sleep21048302-21apt-get21:25:132
10381392101,6sleep21038187-21ntpq21:15:222
10240162101,5sleep11024059-21ntpq21:05:221
10061392101,5sleep21006171-21apt-get20:55:132
999815291,4sleep1999812-21apt-get20:50:151
980397291,5sleep2980400-21cron20:35:002
974780290,7sleep1974325-21/usr/sbin/munin20:30:181
934845291,5sleep2935056-21unixbench-2d19:55:272
922922291,4sleep1922924-21apt-get19:50:111
922625291,5sleep2922655-21basename19:50:002
884168291,4sleep1884166-21apt-get19:20:131
873145291,5sleep0874081-21cat19:10:160
867731290,5sleep30-21swapper/319:05:223
862603290,4sleep20-21swapper/219:05:142
1339202292,3sleep01339235-21apt-get00:35:140
1334410290,6sleep11336374-21kthreadcore00:30:191
1329986291,5sleep01329955-40updatedb.plocat00:26:160
1323553290,3sleep11323838-21tar00:25:001
1302434291,5sleep01303909-21cut00:10:190
1269467291,2sleep20-21swapper/223:48:272
1244860291,4sleep11244914-21ntpq23:30:221
1145487291,4sleep01145533-21ntpq22:25:230
1130075290,5sleep21130115-21ntpq22:15:232
1109847291,5sleep01110013-21sed22:05:140
1093597290,3sleep11093603-21ssh21:54:001
1045816290,5sleep11045858-21ntpq21:20:221
980668280,4sleep0980701-21apt-get20:35:150
973153280,4sleep0973198-21ntpq20:25:230
968018281,4sleep2968015-21apt-get20:25:132
955184281,4sleep0955180-21apt-get20:15:130
941017280,4sleep1941067-21ntpq20:00:221
908800280,5sleep0908843-21gcc19:35:230
897032280,4sleep1896826-21appstreamcli19:30:021
895933281,4sleep0896055-21python319:25:240
867775281,2sleep00-21swapper/019:05:230
1306196281,3sleep11306242-21ntpq00:10:241
1284017280,2sleep21284021-21ssh23:55:572
1277525281,4sleep11277531-21ssh23:54:361
1254240281,5sleep01024965-21diskmemload23:38:390
1232081282,3sleep01232114-21apt-get23:25:110
1229692280,5sleep11229734-21ssh23:20:231
1201488281,3sleep21201523-21apt-get23:05:122
1194211281,4sleep01194579-21irqcore23:00:160
1185270281,4sleep21185274-21ssh22:53:212
1185270281,4sleep21185274-21ssh22:53:212
1147839281,4sleep00-21swapper/022:30:090
1139489280,1sleep20-21swapper/222:23:482
1139291281,4sleep01139297-21ssh22:23:140
1134049280,5sleep11135539-21cut22:20:191
1117263280,5sleep01117423-21diskstats22:10:150
1114702280,4sleep21114800-21ntpq22:05:192
1107252280,5sleep21107288-21ntpq22:00:222
1094341281,4sleep10-21swapper/121:55:121
1071207281,4sleep11071242-21apt-get21:40:121
1070510281,4sleep11070516-21ssh21:38:591
1069844280,5sleep21069850-21ssh21:36:522
1060425284,2sleep00-21swapper/021:30:200
1055913281,4sleep11055908-21apt-get21:30:131
1033026281,3sleep11033023-21apt-get21:15:131
989299271,3sleep10-21swapper/120:40:161
909724270,4sleep1909972-21cut19:40:011
897080271,2sleep20-21swapper/219:30:122
884121270,4sleep0883914-21appstreamcli19:20:040
883814271,3sleep2883914-21appstreamcli19:20:012
875324270,4sleep0876631-21kthreadcore19:15:020
869390271,3sleep1870017-21cut19:10:131
1336626270,4sleep01336772-21ntpq00:30:220
1298576270,4sleep21298630-21ssh00:05:242
1285973271,4sleep10-21swapper/100:00:141
1278022271,2sleep10-21swapper/123:55:121
1267736271,3sleep00-21swapper/023:45:210
1255237270,1sleep00-21swapper/023:40:160
1252787270,4sleep21252886-21sed23:35:242
1230867270,4sleep20-21swapper/223:22:122
1222817270,4sleep11222822-21sh23:16:101
1216773271,3sleep00-21swapper/023:15:130
1192557271,3sleep11024965-21diskmemload22:57:211
1192414270,1sleep00-21swapper/022:56:550
1181189271,3sleep10-21swapper/122:50:191
1181189271,3sleep10-21swapper/122:50:191
1170510270,4sleep01170708-21sed22:45:000
1155729271,3sleep11155832-21sort22:35:151
1130165271,3sleep01130202-21ntpq22:15:240
1116909270,4sleep11116961-21munin-run22:10:001
1108714270,1sleep10-21swapper/122:03:101
1094265271,3sleep21093988-21apt-get21:55:052
1088085271,3sleep01089284-21cut21:50:170
1079231271,3sleep01079390-21/usr/sbin/munin21:45:160
1076504270,4sleep01076552-21ntpq21:40:240
1055405270,4sleep11055409-21ssh21:29:301
1032315270,5sleep21032319-21ssh21:13:542
1030713271,3sleep01030842-21python321:10:270
1024061271,3sleep21024103-21ntpq21:05:232
1009969270,4sleep11011107-21memory20:55:201
993280260,3sleep1993223-21appstreamcli20:45:011
988178261,3sleep0989297-21kthreadcore20:40:150
982158260,3sleep2983908-21tr20:35:202
964494261,3sleep2966497-21kthreadcore20:20:212
951393262,2sleep00-21swapper/020:10:200
942267260,3sleep1942300-21apt-get20:05:111
941910260,1sleep00-21swapper/020:03:500
941324260,1sleep20-21swapper/220:00:272
934686260,4sleep0934728-21proc_pri19:55:240
923120261,2sleep00-21swapper/019:50:140
922927260,4sleep20-21swapper/219:50:122
916816261,3sleep0916419-21/usr/sbin/munin19:45:180
910992260,3sleep0912037-21cut19:40:160
897043264,1sleep0868380-21kworker/0:0+kacpid19:30:090
1314701260,1sleep00-21swapper/000:16:250
1308648260,3sleep10-21swapper/100:15:141
1307591260,1sleep21307597-21ssh00:12:582
1293397260,3sleep00-21swapper/000:05:150
1277967260,2sleep01277751-21appstreamcli23:55:030
1277138260,1sleep00-21swapper/023:53:230
1269907260,3sleep11269913-21ssh23:49:431
1255069261,2sleep20-21swapper/223:40:132
1241876260,3sleep21243761-21tr23:30:192
1229836260,3sleep01229964-21python323:20:260
1216423260,3sleep01216538-21latency_hist23:15:000
1214998260,1sleep20-21swapper/223:10:372
1214322260,3sleep11214365-21ld23:10:201
1195323260,4sleep21197057-21kthreadcore23:00:192
1194580260,3sleep11195322-21grep23:00:181
1183715260,3sleep01183760-21ld22:50:230
1183715260,3sleep01183760-21ld22:50:220
1176112261,2sleep10-21swapper/122:45:251
1172316261,2sleep00-21swapper/022:45:200
1170780260,1sleep20-21swapper/222:45:062
1164162260,3sleep21164664-21ssh22:40:182
1161707260,3sleep01161713-21ssh22:36:380
1154525260,1sleep11154531-21ssh22:32:581
1154433260,1sleep20-21swapper/222:32:432
1140187261,2sleep11140222-21apt-get22:25:121
1130774260,1sleep11130780-21ssh22:15:421
1085882261,3sleep11085888-21ssh21:48:461
1085193260,2sleep20-21swapper/221:46:422
1071708260,3sleep21072697-21uname21:40:172
1062239260,1sleep20-21swapper/221:32:022
1031224261,2sleep10-21swapper/121:10:361
1018400260,1sleep00-21swapper/021:02:330
1017602260,3sleep21017658-21ntpq21:00:232
1012509260,2sleep11012531-21apt-get21:00:141
1012049260,1sleep00-21swapper/020:57:550
1001236260,3sleep21002488-21cut20:50:202
993047250,1sleep20-21swapper/220:43:462
974324250,2sleep0974357-21apt-get20:30:120
954842250,1sleep10-21swapper/120:14:311
917194251,2sleep10-21swapper/119:45:191
903516250,2sleep20-21swapper/219:35:132
896511250,1sleep20-21swapper/219:27:032
895803250,1sleep10-21swapper/119:25:211
879553250,3sleep1881445-21kthreadcore19:15:191
874458250,3sleep20-21swapper/219:10:222
1344372250,2sleep11344425-21ssh00:35:231
1340720250,2sleep21342334-21ssh00:35:202
1318181250,2sleep00-21swapper/000:20:180
1300086250,3sleep11300092-21ssh00:08:171
1270282250,2sleep21270297-21ssh23:50:132
1247380250,2sleep10-21swapper/123:35:111
1237247250,2sleep10-21swapper/123:25:201
1221991250,3sleep21185276-21kworker/u16:3+xprtiod23:15:222
1122482250,2sleep11122530-21ssh22:10:241
1098664250,3sleep01099391-21sed21:55:190
1054318250,3sleep00-21swapper/021:26:200
1046591251,2sleep20-21swapper/221:20:552
1032986251,2sleep00-21swapper/021:15:120
1005533250,1sleep00-21swapper/020:50:380
985957240,2sleep1986080-21python320:35:281
974044240,3sleep10-21swapper/120:29:531
942263240,3sleep20-21swapper/220:05:082
912038240,2sleep1913944-21kthreadcore19:40:171
910212240,2sleep2910412-21smartctl19:40:142
1322626240,2sleep11322632-21ssh00:22:161
1046865240,1sleep00-21swapper/021:21:420
1018894240,1sleep00-21swapper/021:05:130
993429230,1sleep20-21swapper/220:45:032
956608230,1sleep20-21swapper/220:15:192
955185230,1sleep10-21swapper/120:15:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional