You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-30 - 18:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot7s.osadl.org (updated Sun Aug 30, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
100986921090,1sleep20-21swapper/209:00:192
139099870,52rtkit-daemon0-21swapper/107:07:381
96925827740,13sleep30-21swapper/307:06:563
96805627346,17sleep00-21swapper/007:05:130
96826326943,18sleep20-21swapper/207:05:152
10713512590,3sleep00-21swapper/011:55:170
10745652410,4sleep13056-21PK-Backend12:05:121
10284902400,1chrt1028352-21/usr/sbin/munin09:55:132
9765102380,2sleep13056-21PK-Backend07:25:231
10275032320,4sleep20-21swapper/209:50:202
10625682300,5chrt0-21swapper/211:30:172
96964299298,9cyclictest992329-21taskset08:11:113
96964299298,13cyclictest0-21swapper/307:13:093
969642992912,15cyclictest993561-21awk08:15:143
969642992911,16cyclictest1052957-21cat11:05:013
10780942290,4sleep13056-21PK-Backend12:15:151
969642992822,4cyclictest913-21gdbus08:40:013
969642992811,15cyclictest981378-21ls07:40:193
969642992811,15cyclictest981378-21ls07:40:183
96964299278,10cyclictest0-21swapper/308:28:443
96964299277,12cyclictest0-21swapper/307:37:143
969642992720,5cyclictest1058728-21cpuspeed11:20:113
969642992719,4cyclictest1031842-21apt10:05:113
969642992713,13cyclictest998748-21df08:30:133
969642992713,12cyclictest983382-21python307:45:223
969642992713,12cyclictest1084325-21seq12:34:273
969642992713,12cyclictest1046354-21df10:45:123
969642992712,13cyclictest1086150-21munin-run12:40:003
96964299269,15cyclictest1012722-21cstates09:10:133
96964299267,6cyclictest1018851-21taskset09:25:583
969642992622,3cyclictest0-21swapper/312:02:183
969642992611,13cyclictest1074573-21cstates12:05:123
969642992611,13cyclictest1026836-21expr09:50:123
96964299258,4cyclictest977263-21apt07:30:123
969642992521,3cyclictest0-21swapper/308:47:373
969642992519,4cyclictest436-20systemd-journal09:01:143
969642992518,4cyclictest1062118-21apt11:30:133
969642992515,7cyclictest1075980-21taskset12:10:133
969642992512,12cyclictest1047963-21/usr/sbin/munin10:50:133
969642992512,11cyclictest1069656-21/usr/sbin/munin11:50:183
969642992511,4cyclictest1045131-21smartctl10:40:213
969642992511,13cyclictest0-21swapper/312:15:113
969642992511,12cyclictest1041798-21grep10:30:233
96964299249,13cyclictest0-21swapper/311:45:203
96964299249,12cyclictest1033587-21apt10:10:103
96964299243,2cyclictest0-21swapper/312:20:163
969642992415,6cyclictest1057775-21python311:15:223
969642992414,8cyclictest995646-21/usr/sbin/munin08:20:183
969642992412,11cyclictest986685-21ntp_kernel_err07:55:183
969642992411,11cyclictest972032-21/usr/sbin/munin07:15:133
969642992411,11cyclictest1051322-21latency_hist11:00:013
969642992410,13cyclictest1036778-21cron10:20:003
96964299238,13cyclictest1025779-21smartctl09:45:223
96964299238,13cyclictest1025779-21smartctl09:45:223
969642992316,5cyclictest1031184-21users10:00:233
969642992316,3cyclictest1014244-21apt09:15:113
969642992314,7cyclictest1070825-21/usr/sbin/munin11:55:123
969642992314,7cyclictest1064185-21cstates11:35:113
969642992313,8cyclictest1081437-21expr12:25:133
969642992313,8cyclictest1006870-21gpg-connect-age08:55:003
969642992312,9cyclictest1008036-21awk08:55:183
969642992311,11cyclictest978-21snmpd07:53:093
969642992311,11cyclictest978-21snmpd07:53:093
96963999230,21cyclictest1057312-21hddtemp_smartct11:15:162
96963699230,21cyclictest3056-21PK-Backend12:20:121
139099230,15rtkit-daemon3056-21PK-Backend11:07:031
9822772220,4sleep10-21swapper/107:45:001
9822772220,4sleep10-21swapper/107:45:001
969642992216,3cyclictest1022311-21python309:35:203
969642992214,7cyclictest1055110-21cpuspeed_turbos11:10:133
969642992214,5cyclictest1028378-21apt09:55:133
969642992213,7cyclictest989819-21diskstats08:05:143
969642992213,7cyclictest988091-21/usr/sbin/munin08:00:143
969642992213,7cyclictest976303-21/usr/sbin/munin07:25:213
969642992213,7cyclictest1039729-21/usr/sbin/munin10:25:193
969642992213,7cyclictest1037604-21cstates10:20:133
969642992213,7cyclictest1019770-21expr09:30:133
969642992213,7cyclictest1016702-21/usr/sbin/munin09:20:213
969642992212,8cyclictest974088-21expr07:20:133
969642992212,8cyclictest1053582-21sshd11:05:143
969642992212,8cyclictest1044196-21cat10:40:003
969642992210,10cyclictest1010749-21/usr/sbin/munin09:05:183
969639992220,1cyclictest0-21swapper/211:41:392
969639992220,1cyclictest0-21swapper/208:38:002
969639992220,1cyclictest0-21swapper/208:30:432
969639992218,2cyclictest1038794-21munin-run10:25:002
96963699220,20cyclictest3056-21PK-Backend12:03:291
96963699220,20cyclictest3056-21PK-Backend10:46:501
969631992220,1cyclictest0-21swapper/011:32:170
969631992220,1cyclictest0-21swapper/010:04:370
969631992220,1cyclictest0-21swapper/009:35:090
969631992220,1cyclictest0-21swapper/008:26:150
969631992220,1cyclictest0-21swapper/007:46:340
139099220,15rtkit-daemon3056-21PK-Backend10:58:471
139099220,14rtkit-daemon3056-21PK-Backend09:05:581
139099220,14rtkit-daemon0-21swapper/007:58:390
969642992112,8cyclictest1060595-21ls11:25:123
969642992112,8cyclictest1023435-21expr09:40:133
969642992112,7cyclictest1001853-21dpkg08:40:113
969642992111,9cyclictest1065634-21/usr/sbin/munin11:40:123
969639992119,1cyclictest0-21swapper/212:24:252
969639992119,1cyclictest0-21swapper/212:01:262
969639992119,1cyclictest0-21swapper/211:56:262
969639992119,1cyclictest0-21swapper/211:23:272
969639992119,1cyclictest0-21swapper/210:39:542
969639992119,1cyclictest0-21swapper/210:13:042
969639992119,1cyclictest0-21swapper/208:55:102
969639992119,1cyclictest0-21swapper/208:49:512
969639992119,1cyclictest0-21swapper/208:29:562
969639992119,1cyclictest0-21swapper/207:32:442
969639992117,3cyclictest989841-21hddtemp_smartct08:05:152
96963999210,20cyclictest0-21swapper/210:07:312
96963999210,20cyclictest0-21swapper/207:50:482
96963999210,20cyclictest0-21swapper/207:50:482
96963999210,20cyclictest0-21swapper/207:36:152
96963999210,19cyclictest0-21swapper/212:30:132
96963999210,19cyclictest0-21swapper/211:35:032
96963699210,20cyclictest3056-21PK-Backend09:32:411
969631992119,1cyclictest0-21swapper/011:51:030
969631992119,1cyclictest0-21swapper/011:40:280
969631992119,1cyclictest0-21swapper/011:06:560
969631992119,1cyclictest0-21swapper/010:54:320
969631992119,1cyclictest0-21swapper/010:40:460
969631992119,1cyclictest0-21swapper/010:25:050
969631992119,1cyclictest0-21swapper/010:21:550
969631992119,1cyclictest0-21swapper/010:18:430
969631992119,1cyclictest0-21swapper/009:56:060
969631992119,1cyclictest0-21swapper/009:53:420
969631992119,1cyclictest0-21swapper/009:34:230
969631992119,1cyclictest0-21swapper/009:21:440
969631992119,1cyclictest0-21swapper/007:19:510
96963199210,20cyclictest0-21swapper/012:02:250
96963199210,20cyclictest0-21swapper/010:37:350
96963199210,20cyclictest0-21swapper/009:46:110
96963199210,20cyclictest0-21swapper/009:46:110
96963199210,20cyclictest0-21swapper/008:31:570
139099210,15rtkit-daemon3056-21PK-Backend11:25:170
139099210,15rtkit-daemon3056-21PK-Backend10:04:521
139099210,14rtkit-daemon3056-21PK-Backend08:10:041
139099210,13rtkit-daemon3056-21PK-Backend08:31:331
969639992018,1cyclictest0-21swapper/212:14:382
969639992018,1cyclictest0-21swapper/212:07:142
969639992018,1cyclictest0-21swapper/210:54:412
969639992018,1cyclictest0-21swapper/210:49:412
969639992018,1cyclictest0-21swapper/210:43:532
969639992018,1cyclictest0-21swapper/210:25:482
969639992018,1cyclictest0-21swapper/209:41:212
969639992018,1cyclictest0-21swapper/209:12:562
969639992018,1cyclictest0-21swapper/207:20:062
969639992014,4cyclictest2156-21gnome-shell11:04:092
969639992014,4cyclictest2156-21gnome-shell09:15:092
969639992013,6cyclictest1022189-21ntpq09:35:182
969639992013,5cyclictest1061103-21ntpq11:25:182
969639992012,6cyclictest436-20systemd-journal11:55:002
96963999200,19cyclictest0-21swapper/211:06:172
96963999200,19cyclictest0-21swapper/210:16:152
96963999200,19cyclictest0-21swapper/209:26:202
96963999200,19cyclictest0-21swapper/208:53:352
96963999200,19cyclictest0-21swapper/208:40:582
96963999200,19cyclictest0-21swapper/208:20:432
969636992017,2cyclictest3056-21PK-Backend11:43:351
969636992017,2cyclictest3056-21PK-Backend08:36:311
96963699200,1cyclictest3056-21PK-Backend11:46:461
96963699200,1cyclictest3056-21PK-Backend11:34:021
96963699200,1cyclictest3056-21PK-Backend09:45:401
96963699200,1cyclictest3056-21PK-Backend09:45:391
96963699200,1cyclictest3056-21PK-Backend09:25:251
96963699200,1cyclictest3056-21PK-Backend08:55:101
96963699200,1cyclictest3056-21PK-Backend08:47:531
96963699200,18cyclictest3056-21PK-Backend07:52:181
96963699200,18cyclictest3056-21PK-Backend07:52:171
96963699200,18cyclictest3056-21PK-Backend07:20:541
969631992018,1cyclictest0-21swapper/009:12:520
969631992018,1cyclictest0-21swapper/008:51:360
969631992018,1cyclictest0-21swapper/007:42:150
969631992018,1cyclictest0-21swapper/007:42:150
969631992014,4cyclictest1077449-21idleruntime-cro12:15:000
969631992013,5cyclictest994896-21sort08:20:100
96963199200,19cyclictest0-21swapper/011:17:300
96963199200,19cyclictest0-21swapper/010:06:120
96963199200,19cyclictest0-21swapper/009:27:390
96963199200,19cyclictest0-21swapper/009:04:480
96963199200,19cyclictest0-21swapper/008:57:310
96963199200,19cyclictest0-21swapper/008:36:150
96963199200,19cyclictest0-21swapper/007:10:170
96963199200,18cyclictest0-21swapper/009:05:350
96963199200,18cyclictest0-21swapper/007:25:040
139099200,14rtkit-daemon3056-21PK-Backend11:28:011
139099200,13rtkit-daemon3056-21PK-Backend10:26:081
9849562190,3sleep00-21swapper/007:50:160
9849562190,3sleep00-21swapper/007:50:160
969639991917,1cyclictest0-21swapper/209:07:002
969639991917,1cyclictest0-21swapper/208:17:122
969639991917,1cyclictest0-21swapper/207:42:442
969639991917,1cyclictest0-21swapper/207:42:442
969639991917,1cyclictest0-21swapper/207:25:212
969639991916,2cyclictest0-21swapper/209:45:062
969639991916,2cyclictest0-21swapper/209:45:062
969639991912,5cyclictest987791-21cat08:00:112
969639991912,5cyclictest1016427-21cat09:20:182
96963999190,1cyclictest0-21swapper/209:33:022
96963999190,18cyclictest0-21swapper/207:18:442
969636991917,1cyclictest3056-21PK-Backend11:51:321
969636991917,1cyclictest3056-21PK-Backend09:12:271
969636991917,1cyclictest3056-21PK-Backend08:53:011
969636991917,1cyclictest3056-21PK-Backend08:23:141
969636991916,2cyclictest3056-21PK-Backend12:30:331
96963699190,1cyclictest3056-21PK-Backend12:13:021
96963699190,1cyclictest3056-21PK-Backend11:38:001
96963699190,1cyclictest3056-21PK-Backend10:37:311
96963699190,1cyclictest3056-21PK-Backend10:08:101
96963699190,1cyclictest3056-21PK-Backend09:52:081
96963699190,1cyclictest3056-21PK-Backend09:37:011
96963699190,1cyclictest3056-21PK-Backend09:24:381
96963699190,1cyclictest3056-21PK-Backend07:16:281
96963699190,1cyclictest0-21swapper/109:00:171
96963699190,18cyclictest3056-21PK-Backend10:23:381
96963699190,18cyclictest3056-21PK-Backend10:16:421
96963699190,17cyclictest3056-21PK-Backend10:43:391
969631991917,1cyclictest0-21swapper/012:25:580
969631991917,1cyclictest0-21swapper/009:43:140
969631991917,1cyclictest0-21swapper/008:11:350
96963199190,1cyclictest0-21swapper/012:32:200
96963199190,1cyclictest0-21swapper/008:02:090
96963199190,1cyclictest0-21swapper/007:35:110
96963199190,1cyclictest0-21swapper/007:23:420
10416642190,4sleep23056-21PK-Backend10:30:222
969639991816,1cyclictest0-21swapper/207:47:522
969639991813,3cyclictest978-21snmpd10:57:142
969639991811,5cyclictest1082677-21systemd-run12:30:002
96963999181,12cyclictest985982-21apt07:55:122
969636991816,1cyclictest3056-21PK-Backend12:26:341
969636991816,1cyclictest3056-21PK-Backend11:20:301
969636991816,1cyclictest3056-21PK-Backend11:10:571
969636991816,1cyclictest3056-21PK-Backend11:02:591
969636991816,1cyclictest3056-21PK-Backend10:10:341
969636991816,1cyclictest3056-21PK-Backend09:59:041
969636991813,3cyclictest1041327-21latency10:30:171
96963699180,17cyclictest3056-21PK-Backend11:17:391
96963199189,7cyclictest1-21systemd11:50:000
969631991816,1cyclictest0-21swapper/008:48:390
969631991816,1cyclictest0-21swapper/008:41:220
969631991816,1cyclictest0-21swapper/007:31:060
969631991810,6cyclictest1052036-21memory11:00:180
969639991715,1cyclictest0-21swapper/208:12:182
969639991712,3cyclictest1068781-21dump-pmu-power11:50:002
96963999171,12cyclictest969839-21apt07:10:122
969636991715,1cyclictest3056-21PK-Backend08:40:501
969636991715,1cyclictest3056-21PK-Backend08:29:281
969636991715,1cyclictest3056-21PK-Backend08:16:231
969636991715,1cyclictest3056-21PK-Backend08:06:161
969636991715,1cyclictest3056-21PK-Backend08:02:311
969636991715,1cyclictest3056-21PK-Backend07:33:171
969636991714,2cyclictest3056-21PK-Backend07:55:141
969631991715,1cyclictest0-21swapper/011:24:540
969631991712,3cyclictest1079611-21tr12:20:120
969631991711,5cyclictest1056464-21sed11:15:010
969631991710,5cyclictest1033742-21tr10:10:110
10567092170,3sleep21056707-21sed11:15:012
96963999168,6cyclictest1085655-21cat12:35:232
969639991612,3cyclictest1077708-21apt12:15:112
969639991610,5cyclictest1031183-21awk10:00:232
969636991614,1cyclictest3056-21PK-Backend12:35:191
969636991614,1cyclictest3056-21PK-Backend11:55:311
969636991614,1cyclictest3056-21PK-Backend09:16:461
969636991614,1cyclictest3056-21PK-Backend07:10:461
969636991610,4cyclictest983105-21grep07:45:181
969631991614,1cyclictest0-21swapper/009:18:470
969631991614,1cyclictest0-21swapper/008:19:120
969631991612,3cyclictest1085325-21needreboot12:35:180
969631991612,3cyclictest1063847-21apt11:35:100
969631991611,4cyclictest1074401-21cpuspeed_turbos12:05:120
969631991610,4cyclictest1049887-21tr10:55:130
96963199159,4cyclictest989637-21tr08:05:120
139099150,3rtkit-daemon0-21swapper/010:47:270
969636991412,1cyclictest3056-21PK-Backend07:38:121
96963199141,10cyclictest1041650-21python310:30:210
96963699139,3cyclictest3056-21PK-Backend10:53:511
969636991210,1cyclictest3056-21PK-Backend09:40:461
96963199128,3cyclictest1078692-21timerandwakeup12:15:220
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional