You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-17 - 01:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Thu Jul 16, 2026 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
77662722500,8sleep2776614-21perf07:10:002
77589522450,4sleep10-21swapper/107:05:211
77655628039,13sleep30-21swapper/307:09:383
77651627740,14sleep00-21swapper/007:09:060
8129072490,2sleep00-21swapper/008:50:150
8634932480,1chrt862929-21/usr/sbin/munin11:15:151
8826672450,2sleep33056-21PK-Backend12:10:163
8282602360,4sleep33056-21PK-Backend09:35:123
8627282320,4chrt0-21swapper/211:15:002
8875802280,11sleep342-21ksoftirqd/312:25:103
776728992710,3cyclictest838409-21idleruntime-cro10:05:000
77673899240,11cyclictest821817-21ntp_states09:15:193
8235902230,4sleep13056-21PK-Backend09:20:191
776737992318,3cyclictest807579-21df08:35:132
776728992320,2cyclictest0-21swapper/007:38:440
776728992319,2cyclictest789046-21cat07:40:210
77673899225,15cyclictest809172-21expr08:40:123
776738992214,6cyclictest883-21dbus-daemon08:02:243
776737992220,1cyclictest0-21swapper/212:19:492
776737992220,1cyclictest0-21swapper/210:11:262
776737992220,1cyclictest0-21swapper/209:55:372
776737992220,1cyclictest0-21swapper/209:46:442
776737992220,1cyclictest0-21swapper/209:35:362
776737992220,1cyclictest0-21swapper/208:14:522
776737992216,4cyclictest867883-21cron11:30:012
77673799220,3cyclictest818606-21cat09:05:222
776736992219,2cyclictest3056-21PK-Backend10:58:371
776736992216,4cyclictest873494-21grep11:45:111
77673699220,20cyclictest3056-21PK-Backend08:50:001
77673699220,20cyclictest3056-21PK-Backend08:50:001
776728992220,1cyclictest0-21swapper/012:28:360
776728992220,1cyclictest0-21swapper/011:14:350
776728992220,1cyclictest0-21swapper/010:26:430
776728992214,6cyclictest863367-21ls11:15:150
77672899220,21cyclictest0-21swapper/012:10:390
77672899220,21cyclictest0-21swapper/011:09:490
139099220,15rtkit-daemon3056-21PK-Backend10:13:453
139099220,15rtkit-daemon3056-21PK-Backend09:51:393
139099220,15rtkit-daemon0-21swapper/212:09:132
776738992118,2cyclictest0-21swapper/308:07:383
776738992115,4cyclictest2156-21gnome-shell08:49:093
776738992115,4cyclictest2156-21gnome-shell08:49:093
776738992113,6cyclictest889985-21awk12:30:183
776738992113,6cyclictest817345-21cron09:04:593
77673899210,20cyclictest3056-21PK-Backend10:53:273
77673899210,20cyclictest0-21swapper/311:59:443
77673899210,19cyclictest3056-21PK-Backend10:08:053
77673899210,19cyclictest3056-21PK-Backend08:30:173
776737992119,1cyclictest0-21swapper/211:47:452
776737992119,1cyclictest0-21swapper/210:23:292
776737992119,1cyclictest0-21swapper/210:15:032
776737992119,1cyclictest0-21swapper/208:43:452
776737992119,1cyclictest0-21swapper/208:07:422
776737992119,1cyclictest0-21swapper/207:49:502
776737992119,1cyclictest0-21swapper/207:41:332
776737992119,1cyclictest0-21swapper/207:36:122
776737992113,6cyclictest813154-21ntp_states08:50:182
77673799210,20cyclictest0-21swapper/211:55:012
77673799210,20cyclictest0-21swapper/210:27:072
77673799210,20cyclictest0-21swapper/208:32:302
77673799210,20cyclictest0-21swapper/208:02:562
776736992119,1cyclictest0-21swapper/112:15:141
776736992119,1cyclictest0-21swapper/110:37:411
776736992119,1cyclictest0-21swapper/109:13:461
776736992119,1cyclictest0-21swapper/107:10:031
776736992118,2cyclictest3056-21PK-Backend12:27:121
776736992118,2cyclictest3056-21PK-Backend11:33:311
776736992118,2cyclictest3056-21PK-Backend10:25:031
776736992118,2cyclictest3056-21PK-Backend08:40:201
776736992118,2cyclictest3056-21PK-Backend08:16:481
776736992118,2cyclictest0-21swapper/111:11:001
776736992118,2cyclictest0-21swapper/109:29:131
776736992113,6cyclictest851391-21sed10:40:171
776736992113,6cyclictest840995-21memory10:10:171
776736992113,6cyclictest838673-21apt10:05:121
77673699210,20cyclictest3056-21PK-Backend09:02:031
77673699210,19cyclictest3056-21PK-Backend12:20:161
77673699210,19cyclictest3056-21PK-Backend11:38:521
77673699210,19cyclictest3056-21PK-Backend10:16:391
77673699210,19cyclictest3056-21PK-Backend08:10:261
77673699210,19cyclictest3056-21PK-Backend08:01:541
776728992119,1cyclictest3056-21PK-Backend10:40:420
776728992119,1cyclictest0-21swapper/012:32:090
776728992119,1cyclictest0-21swapper/012:08:090
776728992119,1cyclictest0-21swapper/011:59:430
776728992119,1cyclictest0-21swapper/010:47:250
776728992119,1cyclictest0-21swapper/010:06:140
776728992119,1cyclictest0-21swapper/009:48:300
776728992119,1cyclictest0-21swapper/009:33:420
776728992119,1cyclictest0-21swapper/009:15:110
776728992119,1cyclictest0-21swapper/008:30:300
776728992119,1cyclictest0-21swapper/008:02:180
776728992119,1cyclictest0-21swapper/007:51:360
776728992119,1cyclictest0-21swapper/007:35:000
776728992119,1cyclictest0-21swapper/007:11:550
77672899210,20cyclictest0-21swapper/012:21:260
77672899210,20cyclictest0-21swapper/009:01:310
77672899210,20cyclictest0-21swapper/007:56:090
139099210,15rtkit-daemon3056-21PK-Backend09:06:273
139099210,14rtkit-daemon3056-21PK-Backend12:07:523
139099210,14rtkit-daemon3056-21PK-Backend09:57:153
139099210,14rtkit-daemon3056-21PK-Backend09:49:363
139099210,14rtkit-daemon3056-21PK-Backend09:26:263
139099210,14rtkit-daemon0-21swapper/211:32:252
139099210,14rtkit-daemon0-21swapper/211:00:552
139099210,14rtkit-daemon0-21swapper/210:46:482
139099210,14rtkit-daemon0-21swapper/210:35:292
139099210,14rtkit-daemon0-21swapper/209:43:492
77673899207,11cyclictest847087-21cron10:30:013
776738992018,1cyclictest0-21swapper/311:50:453
776738992017,2cyclictest0-21swapper/307:38:463
776738992012,6cyclictest871348-21cron11:40:003
776738992012,6cyclictest858527-21awk11:00:183
77673899200,19cyclictest3056-21PK-Backend09:31:353
77673899200,19cyclictest3056-21PK-Backend07:46:173
77673899200,19cyclictest0-21swapper/308:15:373
77673899200,19cyclictest0-21swapper/307:27:443
77673899200,18cyclictest3056-21PK-Backend10:30:493
776737992018,1cyclictest3056-21PK-Backend08:25:202
776737992018,1cyclictest0-21swapper/210:51:072
776737992018,1cyclictest0-21swapper/209:53:402
776737992018,1cyclictest0-21swapper/209:01:162
776737992018,1cyclictest0-21swapper/208:55:482
776737992018,1cyclictest0-21swapper/207:32:272
776737992018,1cyclictest0-21swapper/207:16:122
776737992017,2cyclictest3056-21PK-Backend08:20:392
776737992012,6cyclictest792342-21ntp_states07:50:162
77673799200,19cyclictest3056-21PK-Backend11:20:342
77673799200,19cyclictest0-21swapper/211:41:022
77673799200,19cyclictest0-21swapper/211:41:012
77673799200,19cyclictest0-21swapper/211:37:232
77673799200,19cyclictest0-21swapper/211:15:132
776736992018,1cyclictest3056-21PK-Backend12:38:541
776736992018,1cyclictest3056-21PK-Backend08:56:021
776736992018,1cyclictest3056-21PK-Backend08:09:381
776736992018,1cyclictest0-21swapper/112:04:411
776736992018,1cyclictest0-21swapper/110:34:371
776736992018,1cyclictest0-21swapper/109:55:431
776736992018,1cyclictest0-21swapper/108:53:171
776736992018,1cyclictest0-21swapper/108:35:061
776736992018,1cyclictest0-21swapper/108:33:441
776736992017,2cyclictest3056-21PK-Backend11:29:191
776736992017,2cyclictest3056-21PK-Backend10:46:531
776736992017,2cyclictest3056-21PK-Backend10:20:161
776736992012,6cyclictest875360-21apt11:50:111
77673699200,19cyclictest3056-21PK-Backend07:28:541
77673699200,19cyclictest3056-21PK-Backend07:24:021
77673699200,19cyclictest0-21swapper/111:24:311
77673699200,19cyclictest0-21swapper/109:46:171
77673699200,19cyclictest0-21swapper/109:40:091
77673699200,19cyclictest0-21swapper/109:36:311
77673699200,19cyclictest0-21swapper/109:32:521
77673699200,19cyclictest0-21swapper/109:06:091
77673699200,19cyclictest0-21swapper/108:22:081
77673699200,18cyclictest3056-21PK-Backend07:52:481
776728992018,1cyclictest0-21swapper/012:19:300
776728992018,1cyclictest0-21swapper/011:28:540
776728992018,1cyclictest0-21swapper/011:24:430
776728992018,1cyclictest0-21swapper/011:01:020
776728992018,1cyclictest0-21swapper/010:57:580
776728992018,1cyclictest0-21swapper/010:37:370
776728992018,1cyclictest0-21swapper/010:30:200
776728992018,1cyclictest0-21swapper/009:21:400
776728992018,1cyclictest0-21swapper/008:49:290
776728992018,1cyclictest0-21swapper/008:49:290
776728992018,1cyclictest0-21swapper/007:22:020
776728992013,6cyclictest829938-21expr09:40:140
77672899200,1cyclictest0-21swapper/008:42:540
77672899200,19cyclictest0-21swapper/011:51:180
77672899200,19cyclictest0-21swapper/011:40:240
77672899200,19cyclictest0-21swapper/011:40:240
77672899200,19cyclictest0-21swapper/008:27:120
77672899200,19cyclictest0-21swapper/008:21:240
77672899200,19cyclictest0-21swapper/007:29:050
139099200,14rtkit-daemon3056-21PK-Backend11:17:413
139099200,14rtkit-daemon3056-21PK-Backend10:36:033
139099200,14rtkit-daemon3056-21PK-Backend09:25:252
139099200,14rtkit-daemon3056-21PK-Backend07:14:533
139099200,14rtkit-daemon0-21swapper/308:39:253
139099200,14rtkit-daemon0-21swapper/212:01:572
139099200,14rtkit-daemon0-21swapper/209:15:252
139099200,14rtkit-daemon0-21swapper/207:21:132
139099200,13rtkit-daemon3056-21PK-Backend09:44:443
139099200,13rtkit-daemon0-21swapper/207:14:482
776738991917,1cyclictest3056-21PK-Backend08:52:343
776738991917,1cyclictest3056-21PK-Backend08:26:253
776738991917,1cyclictest0-21swapper/312:18:103
776738991917,1cyclictest0-21swapper/310:41:443
776738991917,1cyclictest0-21swapper/308:10:493
776738991917,1cyclictest0-21swapper/307:57:323
776738991917,1cyclictest0-21swapper/307:30:423
776738991914,3cyclictest978-21snmpd07:17:543
776738991914,3cyclictest865088-21hddtemp_smartct11:20:153
776738991914,3cyclictest844627-21ntp_states10:20:193
776738991914,3cyclictest791605-21apt07:50:093
776738991912,6cyclictest874821-21cron11:50:003
776738991912,6cyclictest823566-21open_files09:20:193
776738991912,5cyclictest802765-21ntpq08:20:203
77673899190,7cyclictest843620-21munin-run10:20:013
77673899190,1cyclictest0-21swapper/312:22:353
77673899190,1cyclictest0-21swapper/308:57:143
77673899190,18cyclictest3056-21PK-Backend11:42:553
77673899190,18cyclictest3056-21PK-Backend11:42:553
77673899190,18cyclictest3056-21PK-Backend11:11:253
77673899190,18cyclictest0-21swapper/311:29:443
77673899190,18cyclictest0-21swapper/310:47:533
77673799192,12cyclictest885758-21apt12:20:092
776737991917,1cyclictest3056-21PK-Backend10:05:172
776737991917,1cyclictest0-21swapper/210:56:072
776737991917,1cyclictest0-21swapper/209:22:452
776737991917,1cyclictest0-21swapper/209:11:022
776737991917,1cyclictest0-21swapper/208:48:582
776737991917,1cyclictest0-21swapper/208:48:582
776737991915,3cyclictest1095-21runrttasks07:26:382
776737991911,6cyclictest801352-21awk08:15:222
776737991911,6cyclictest794062-21ntp_kernel_pll_07:55:212
77673799190,1cyclictest0-21swapper/210:01:592
77673799190,18cyclictest0-21swapper/212:11:312
776736991917,1cyclictest3056-21PK-Backend12:33:271
776736991917,1cyclictest3056-21PK-Backend11:59:541
776736991917,1cyclictest3056-21PK-Backend07:57:201
776736991917,1cyclictest0-21swapper/112:10:481
776736991917,1cyclictest0-21swapper/112:08:531
776736991917,1cyclictest0-21swapper/110:53:011
776736991917,1cyclictest0-21swapper/107:15:161
77673699190,18cyclictest0-21swapper/108:26:331
77673699190,18cyclictest0-21swapper/107:46:531
776728991917,1cyclictest3056-21PK-Backend09:05:040
776728991917,1cyclictest3056-21PK-Backend07:17:570
776728991917,1cyclictest0-21swapper/012:35:400
776728991917,1cyclictest0-21swapper/009:55:270
776728991917,1cyclictest0-21swapper/009:36:470
776728991917,1cyclictest0-21swapper/008:05:280
139099190,14rtkit-daemon0-21swapper/210:43:072
139099190,13rtkit-daemon3056-21PK-Backend10:01:593
139099190,13rtkit-daemon0-21swapper/307:20:443
77673899181,15cyclictest856026-21apt10:55:103
77673899180,16cyclictest890966-21apt12:35:113
77673899180,16cyclictest869233-21users11:30:223
77673799182,13cyclictest891829-21python312:35:202
776736991816,1cyclictest0-21swapper/111:41:561
776736991816,1cyclictest0-21swapper/111:41:551
776736991816,1cyclictest0-21swapper/110:00:091
776736991816,1cyclictest0-21swapper/107:43:081
776736991816,1cyclictest0-21swapper/107:35:381
776736991816,1cyclictest0-21swapper/107:34:501
776736991812,4cyclictest861176-21date11:10:011
776736991812,4cyclictest834813-21seq09:53:351
77673699180,1cyclictest3056-21PK-Backend11:02:461
776728991816,1cyclictest0-21swapper/011:36:120
776728991814,3cyclictest13-21ksoftirqd/010:20:010
776728991813,3cyclictest825247-21netstat09:25:170
77672899180,1cyclictest0-21swapper/009:51:180
139099180,3rtkit-daemon0-21swapper/209:33:092
8594922170,1sleep20-21swapper/211:05:112
77673799173,12cyclictest876809-21cron11:55:002
776737991715,1cyclictest0-21swapper/212:34:352
776736991715,1cyclictest3056-21PK-Backend09:19:411
776728991715,1cyclictest0-21swapper/010:22:300
776728991715,1cyclictest0-21swapper/008:55:300
776728991715,1cyclictest0-21swapper/007:47:510
139099170,3rtkit-daemon0-21swapper/210:32:482
77673899167,8cyclictest788808-21needreboot07:40:163
776738991610,4cyclictest878544-21cron12:00:013
776737991610,5cyclictest888019-21sed12:25:162
77672899162,11cyclictest819347-21apt09:10:100
776728991614,1cyclictest0-21swapper/012:03:220
776728991614,1cyclictest0-21swapper/011:32:320
776728991614,1cyclictest0-21swapper/010:14:390
776728991611,4cyclictest801780-21systemd08:20:010
776728991611,3cyclictest874096-21sh11:45:170
776728991610,5cyclictest800017-21/usr/sbin/munin08:15:010
77673899150,2cyclictest859869-21entropy11:05:143
77673899150,13cyclictest819321-21/usr/sbin/munin09:10:213
77672899157,6cyclictest808512-21pool-udisksd08:38:020
776728991412,1cyclictest0-21swapper/010:52:250
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional