You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-04 - 05:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot7s.osadl.org (updated Sat Apr 04, 2026 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
93924721320,2sleep30-21swapper/300:20:133
9083452960,3sleep30-21swapper/322:55:003
139099910,73rtkit-daemon0-21swapper/319:05:203
82756627339,28sleep00-21swapper/019:06:420
82749826743,17sleep20-21swapper/219:05:512
82649126442,14sleep10-21swapper/119:05:141
8593692400,2sleep342-21ksoftirqd/320:35:183
139099330,2rtkit-daemon0-21swapper/220:48:282
139099280,4rtkit-daemon1389-21rtkit-daemon23:07:082
827957992618,5cyclictest851193-21dump-pmu-power20:14:593
827949992519,4cyclictest897658-21apt22:25:101
82794699251,22cyclictest890913-21/usr/sbin/munin22:05:170
139099250,4rtkit-daemon1389-21rtkit-daemon21:39:432
82795799241,21cyclictest924227-21apt-config23:40:003
827952992419,4cyclictest1095-21runrttasks20:54:532
827946992415,6cyclictest837070-21munin-run19:35:000
827946992415,5cyclictest1095-21runrttasks22:25:030
9356692230,4sleep2331rcuc/200:10:112
82795799239,10cyclictest883-21dbus-daemon00:25:203
82795799237,14cyclictest927156-21/usr/sbin/munin23:45:163
82795799231,9cyclictest931683-21munin-run00:00:013
82795799230,3cyclictest843277-21ntp_states19:50:193
82795799230,21cyclictest3056-21PK-Backend22:06:393
82795799230,10cyclictest8611382ntp_states20:40:173
139099230,3rtkit-daemon1389-21rtkit-daemon23:52:583
9435342220,10sleep013-21ksoftirqd/000:30:220
8611392220,2sleep13056-21PK-Backend20:40:181
827957992220,1cyclictest0-21swapper/323:20:283
827957992220,1cyclictest0-21swapper/321:24:363
827957992220,1cyclictest0-21swapper/321:24:353
827957992214,6cyclictest911783-21sh23:05:003
827957992211,7cyclictest1095-21runrttasks23:40:033
82795299224,17cyclictest835312-21ls19:30:002
827952992220,1cyclictest0-21swapper/222:58:022
827952992220,1cyclictest0-21swapper/222:06:592
827952992220,1cyclictest0-21swapper/219:31:592
827952992215,5cyclictest879485-21sh21:35:002
827952992211,9cyclictest859371-21netstat20:35:182
82795299220,21cyclictest0-21swapper/221:26:512
827946992220,1cyclictest0-21swapper/021:06:150
827946992220,1cyclictest0-21swapper/019:49:020
827946992220,1cyclictest0-21swapper/000:11:160
827946992213,7cyclictest1-21systemd22:35:000
82794699220,20cyclictest436-20systemd-journal00:00:010
827957992119,1cyclictest3056-21PK-Backend19:25:463
827957992119,1cyclictest3056-21PK-Backend19:22:073
827957992119,1cyclictest3056-21PK-Backend19:15:043
827957992119,1cyclictest3056-21PK-Backend19:15:043
827957992119,1cyclictest3056-21PK-Backend00:38:223
827957992119,1cyclictest0-21swapper/322:59:123
827957992119,1cyclictest0-21swapper/321:47:403
827957992119,1cyclictest0-21swapper/321:32:053
827957992119,1cyclictest0-21swapper/321:14:213
827957992119,1cyclictest0-21swapper/321:05:353
827957992119,1cyclictest0-21swapper/320:55:153
827957992119,1cyclictest0-21swapper/320:09:043
827957992119,1cyclictest0-21swapper/320:04:053
827957992119,1cyclictest0-21swapper/300:05:363
827957992113,5cyclictest886-21NetworkManager23:30:213
827957992112,5cyclictest0-21swapper/323:10:113
82795799211,18cyclictest942582-21/usr/sbin/munin00:30:133
82795799210,20cyclictest0-21swapper/321:18:403
82795799210,19cyclictest3056-21PK-Backend22:21:473
827952992119,1cyclictest0-21swapper/223:48:182
827952992119,1cyclictest0-21swapper/223:42:242
827952992119,1cyclictest0-21swapper/223:21:212
827952992119,1cyclictest0-21swapper/223:16:152
827952992119,1cyclictest0-21swapper/223:16:142
827952992119,1cyclictest0-21swapper/222:41:262
827952992119,1cyclictest0-21swapper/222:28:142
827952992119,1cyclictest0-21swapper/222:21:472
827952992119,1cyclictest0-21swapper/222:01:582
827952992119,1cyclictest0-21swapper/221:56:582
827952992119,1cyclictest0-21swapper/221:20:562
827952992119,1cyclictest0-21swapper/221:20:552
827952992119,1cyclictest0-21swapper/220:58:042
827952992119,1cyclictest0-21swapper/220:43:582
827952992119,1cyclictest0-21swapper/220:32:092
827952992119,1cyclictest0-21swapper/220:27:492
827952992119,1cyclictest0-21swapper/220:21:202
827952992119,1cyclictest0-21swapper/220:11:412
827952992113,6cyclictest930532-21df23:55:122
82795299210,20cyclictest0-21swapper/223:12:082
827946992119,1cyclictest0-21swapper/023:48:580
827946992119,1cyclictest0-21swapper/023:25:330
827946992119,1cyclictest0-21swapper/023:13:300
827946992119,1cyclictest0-21swapper/023:06:350
827946992119,1cyclictest0-21swapper/023:04:310
827946992119,1cyclictest0-21swapper/022:45:040
827946992119,1cyclictest0-21swapper/021:55:290
827946992119,1cyclictest0-21swapper/021:45:420
827946992119,1cyclictest0-21swapper/020:35:330
827946992119,1cyclictest0-21swapper/020:01:460
827946992119,1cyclictest0-21swapper/019:20:370
827946992113,5cyclictest436-20systemd-journal00:40:000
82794699210,20cyclictest0-21swapper/023:41:150
82794699210,20cyclictest0-21swapper/023:36:210
82794699210,20cyclictest0-21swapper/022:54:580
82794699210,20cyclictest0-21swapper/022:44:030
82794699210,20cyclictest0-21swapper/021:35:080
82794699210,19cyclictest3056-21PK-Backend23:30:260
9407492200,4sleep13056-21PK-Backend00:25:011
8865652200,4sleep2886506-21munin-run21:55:022
82795799204,14cyclictest936307-21needreboot00:10:153
82795799202,13cyclictest978-21snmpd20:50:043
827957992018,1cyclictest3056-21PK-Backend22:17:213
827957992018,1cyclictest3056-21PK-Backend19:37:073
827957992018,1cyclictest3056-21PK-Backend19:33:163
827957992018,1cyclictest0-21swapper/320:17:433
827957992018,1cyclictest0-21swapper/320:17:433
827957992018,1cyclictest0-21swapper/319:56:423
827957992014,4cyclictest2156-21gnome-shell23:05:093
82795799200,19cyclictest3056-21PK-Backend22:29:513
827952992018,1cyclictest0-21swapper/222:46:072
827952992018,1cyclictest0-21swapper/220:16:542
827952992018,1cyclictest0-21swapper/220:16:542
827952992018,1cyclictest0-21swapper/220:09:042
827952992018,1cyclictest0-21swapper/219:47:542
827952992013,5cyclictest941122-21expr00:25:122
827952992013,5cyclictest881752-21cat21:40:132
827952992013,5cyclictest845305-21sed19:55:202
82795299200,1cyclictest0-21swapper/221:14:132
82795299200,1cyclictest0-21swapper/221:01:162
82795299200,19cyclictest0-21swapper/223:32:232
82795299200,19cyclictest0-21swapper/221:46:582
82795299200,19cyclictest0-21swapper/219:43:012
82795299200,19cyclictest0-21swapper/219:15:582
82795299200,19cyclictest0-21swapper/219:15:572
82795299200,19cyclictest0-21swapper/200:30:292
82795299200,19cyclictest0-21swapper/200:09:472
827949992017,2cyclictest0-21swapper/122:16:521
827949992014,3cyclictest911790-21idleruntime-cro23:05:001
827949992012,6cyclictest867332-21cron21:00:001
827949992011,7cyclictest1-21systemd22:40:001
82794999200,1cyclictest3056-21PK-Backend21:05:211
827946992018,1cyclictest3056-21PK-Backend00:22:180
827946992018,1cyclictest0-21swapper/023:23:300
827946992018,1cyclictest0-21swapper/022:04:280
827946992018,1cyclictest0-21swapper/021:27:240
827946992018,1cyclictest0-21swapper/021:14:120
827946992018,1cyclictest0-21swapper/020:40:400
827946992018,1cyclictest0-21swapper/020:07:340
827946992018,1cyclictest0-21swapper/019:51:260
827946992018,1cyclictest0-21swapper/019:27:540
827946992018,1cyclictest0-21swapper/019:16:100
827946992018,1cyclictest0-21swapper/019:16:100
82794699200,1cyclictest0-21swapper/023:52:500
82794699200,19cyclictest0-21swapper/022:36:470
82794699200,19cyclictest0-21swapper/022:18:340
82794699200,19cyclictest0-21swapper/021:18:330
82794699200,19cyclictest0-21swapper/020:48:110
82794699200,19cyclictest0-21swapper/020:26:200
82794699200,19cyclictest0-21swapper/020:17:480
82794699200,19cyclictest0-21swapper/020:17:480
82794699200,19cyclictest0-21swapper/020:11:470
82794699200,19cyclictest0-21swapper/019:43:350
82794699200,19cyclictest0-21swapper/000:07:100
82795799192,14cyclictest880827-21NetworkManager21:35:203
82795799192,13cyclictest881489-21apt21:40:133
827957991917,1cyclictest3056-21PK-Backend20:22:103
827957991917,1cyclictest3056-21PK-Backend19:11:393
827957991917,1cyclictest0-21swapper/322:41:493
827957991917,1cyclictest0-21swapper/321:54:163
827957991917,1cyclictest0-21swapper/321:25:233
827957991917,1cyclictest0-21swapper/321:00:013
827957991917,1cyclictest0-21swapper/300:15:503
827957991916,2cyclictest839115-21cpu19:40:113
82795799191,15cyclictest906349-21http22:50:003
827957991910,7cyclictest889099-21df_inode22:00:133
82795799190,1cyclictest3056-21PK-Backend22:38:573
82795799190,1cyclictest3056-21PK-Backend22:13:433
82795799190,1cyclictest3056-21PK-Backend20:28:583
82795799190,1cyclictest0-21swapper/320:34:403
827952991917,1cyclictest0-21swapper/219:10:442
827952991912,5cyclictest944628-21expr00:35:132
827952991912,5cyclictest436-20systemd-journal23:26:152
82795299190,1cyclictest0-21swapper/223:39:192
82795299190,1cyclictest0-21swapper/223:01:542
82795299190,1cyclictest0-21swapper/221:15:002
82795299190,1cyclictest0-21swapper/219:21:242
82795299190,1cyclictest0-21swapper/200:00:352
82795299190,18cyclictest0-21swapper/219:38:562
827949991912,5cyclictest906473-21sed22:50:011
827949991912,5cyclictest834296-21cat19:25:141
827949991912,4cyclictest1095-21runrttasks22:08:031
82794999190,1cyclictest3056-21PK-Backend20:08:081
827946991917,1cyclictest0-21swapper/021:01:280
827946991917,1cyclictest0-21swapper/020:50:340
827946991917,1cyclictest0-21swapper/019:36:380
827946991917,1cyclictest0-21swapper/019:10:090
82794699190,1cyclictest0-21swapper/022:23:000
82794699190,1cyclictest0-21swapper/020:57:290
82794699190,1cyclictest0-21swapper/000:03:060
82794699190,18cyclictest0-21swapper/022:12:200
82794699190,18cyclictest0-21swapper/021:23:390
82794699190,18cyclictest0-21swapper/021:23:390
82794699190,18cyclictest0-21swapper/000:29:140
139099190,13rtkit-daemon0-21swapper/319:49:203
8996952180,3sleep10-21swapper/122:30:131
8921882180,3sleep10-21swapper/122:10:111
827957991816,1cyclictest3056-21PK-Backend22:30:533
827957991816,1cyclictest0-21swapper/323:17:233
827957991816,1cyclictest0-21swapper/323:17:233
827957991816,1cyclictest0-21swapper/320:47:313
827952991812,5cyclictest894924-21sed22:15:212
827952991812,4cyclictest939067-21cat00:20:002
827952991811,5cyclictest902593-21apt-get22:40:002
827952991811,5cyclictest843587-21cat19:50:212
82794999182,13cyclictest884308-21chrt21:45:211
827949991811,5cyclictest908937-21expr22:55:151
827949991811,5cyclictest882189-21awk21:40:181
827949991811,5cyclictest436-20systemd-journal19:20:001
827949991811,5cyclictest436-20systemd-journal19:19:591
827949991810,6cyclictest886-21NetworkManager19:30:161
827946991816,1cyclictest0-21swapper/023:16:340
827946991816,1cyclictest0-21swapper/023:16:340
827946991816,1cyclictest0-21swapper/021:31:090
82794699180,1cyclictest0-21swapper/000:19:130
82795799176,10cyclictest42-21ksoftirqd/300:00:173
827957991712,3cyclictest887123-21tr21:55:123
827952991715,1cyclictest0-21swapper/222:11:382
827952991710,5cyclictest870943-21sed21:10:012
82794999179,6cyclictest855439-21cut20:25:161
82794999179,6cyclictest26-21ksoftirqd/122:20:211
827949991715,1cyclictest3056-21PK-Backend23:26:551
827949991713,3cyclictest844076-21grep19:55:011
827949991711,5cyclictest833765-21cat19:25:011
827949991711,4cyclictest871230-21cpuspeed_turbos21:10:131
82794999171,12cyclictest829636-21ls19:14:591
827949991710,5cyclictest883-21dbus-daemon22:51:041
82794699179,6cyclictest853309-21cat20:20:130
82794699178,7cyclictest883-21dbus-daemon19:55:180
827946991715,1cyclictest0-21swapper/022:55:590
82795799169,5cyclictest42-21ksoftirqd/323:25:113
82795299169,5cyclictest928755-21expr23:50:132
827952991614,1cyclictest0-21swapper/222:33:562
827952991614,1cyclictest0-21swapper/200:20:152
827952991611,4cyclictest34-21ksoftirqd/220:05:012
82794999167,7cyclictest935126-21cron00:10:001
82794999162,8cyclictest856409-21apt-get20:30:031
827949991613,2cyclictest3056-21PK-Backend23:08:231
827949991611,3cyclictest846917-21switchtime20:00:201
827949991611,3cyclictest837306-21acpi19:35:101
827949991611,3cyclictest1095-21runrttasks19:40:061
82794999161,11cyclictest903124-21apt22:40:121
827949991610,4cyclictest930092-21sed23:55:021
827949991610,4cyclictest844856-21ls19:55:161
82794999160,14cyclictest3056-21PK-Backend00:33:331
82795299151,10cyclictest906814-21apt-get22:50:042
82794999159,5cyclictest920851-21grep23:30:121
82794999159,5cyclictest853431-21expr20:20:131
82794999158,5cyclictest945636-21pool-udisksd00:38:031
827949991513,1cyclictest3056-21PK-Backend21:18:321
827949991513,1cyclictest3056-21PK-Backend20:45:331
827949991513,1cyclictest3056-21PK-Backend00:00:481
827949991512,2cyclictest3056-21PK-Backend00:14:001
827949991511,3cyclictest840992-21cstates19:45:121
827949991511,3cyclictest3056-21PK-Backend20:15:081
827949991511,3cyclictest3056-21PK-Backend20:15:071
827949991511,3cyclictest3056-21PK-Backend00:27:571
82794999151,12cyclictest867977-21diskstats21:00:131
82794999150,14cyclictest3056-21PK-Backend21:27:581
82794999150,13cyclictest3056-21PK-Backend22:00:441
82794699159,5cyclictest882076-21grep21:40:180
827946991513,1cyclictest0-21swapper/020:33:230
827946991512,2cyclictest886712-21apt-config21:55:010
82794999148,4cyclictest917772-21grep23:20:161
82794999146,6cyclictest883-21dbus-daemon21:20:311
82794999146,6cyclictest883-21dbus-daemon21:20:311
827949991412,1cyclictest3056-21PK-Backend21:37:181
827949991412,1cyclictest3056-21PK-Backend20:37:161
827949991410,3cyclictest3056-21PK-Backend23:55:371
827949991410,3cyclictest3056-21PK-Backend23:15:551
827949991410,3cyclictest3056-21PK-Backend23:15:551
827949991410,3cyclictest3056-21PK-Backend21:31:071
827949991410,3cyclictest3056-21PK-Backend20:10:581
82794999140,1cyclictest3056-21PK-Backend23:10:461
82794999140,1cyclictest3056-21PK-Backend21:55:501
82794999139,3cyclictest3056-21PK-Backend20:50:161
82794999139,3cyclictest3056-21PK-Backend00:16:381
82794999131,9cyclictest886470-21perf21:55:001
82794999130,5cyclictest3056-21PK-Backend23:48:211
82794999117,3cyclictest3056-21PK-Backend23:35:281
82794999105,4cyclictest3056-21PK-Backend23:41:541
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional