You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-16 - 15:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Sun Aug 16, 2026 12:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
150609421270,4sleep13056-21PK-Backend10:00:161
144726221050,3sleep00-21swapper/007:15:030
139099710,58rtkit-daemon0-21swapper/307:08:263
144350327045,15sleep10-21swapper/107:05:141
144466226444,13sleep00-21swapper/007:06:010
144460926242,14sleep20-21swapper/207:05:302
14949572580,2sleep00-21swapper/009:30:120
15163432520,4sleep0161rcuc/010:30:110
14542262440,4sleep01454209-21perf07:35:000
15358552370,4sleep30-21swapper/311:25:203
15038422300,3sleep3411rcuc/309:55:023
1445129992817,8cyclictest1507094-21cron10:05:003
139099260,4rtkit-daemon1389-21rtkit-daemon12:17:221
139099260,4rtkit-daemon1389-21rtkit-daemon12:17:211
139099260,4rtkit-daemon1389-21rtkit-daemon10:43:141
139099250,4rtkit-daemon1389-21rtkit-daemon10:54:270
1445121992415,7cyclictest1515171-21python310:25:222
1445121992415,7cyclictest1515171-21python310:25:222
139099240,3rtkit-daemon1389-21rtkit-daemon09:12:590
139099240,21rtkit-daemon1997-21gvfs-afc-volume10:48:071
144512999235,15cyclictest1450764-21unin-run07:24:593
1445129992315,6cyclictest883-21dbus-daemon10:10:003
1445121992321,1cyclictest0-21swapper/208:41:582
1445120992321,1cyclictest0-21swapper/110:10:161
14780182220,4sleep33056-21PK-Backend08:40:143
14617242220,3sleep00-21swapper/007:55:120
1445129992219,2cyclictest3056-21PK-Backend12:01:233
1445129992219,2cyclictest3056-21PK-Backend11:51:083
1445129992218,3cyclictest2156-21gnome-shell10:19:093
1445129992214,6cyclictest1543774-21munin-run11:50:003
1445121992220,1cyclictest0-21swapper/212:07:262
1445121992220,1cyclictest0-21swapper/208:57:252
1445121992220,1cyclictest0-21swapper/208:45:502
1445121992220,1cyclictest0-21swapper/208:35:362
1445121992219,2cyclictest0-21swapper/209:44:232
144512199220,21cyclictest0-21swapper/210:21:352
144512199220,20cyclictest0-21swapper/211:05:552
144512099221,19cyclictest1463197-21sleep08:00:011
1445117992220,1cyclictest0-21swapper/011:37:020
1445117992220,1cyclictest0-21swapper/010:37:540
1445117992220,1cyclictest0-21swapper/008:20:590
1445117992220,1cyclictest0-21swapper/008:20:580
1445117992214,7cyclictest1464193-21ntp_states08:00:200
144511799221,20cyclictest0-21swapper/008:37:080
144511799220,21cyclictest0-21swapper/008:06:260
15016662210,3chrt3056-21PK-Backend09:50:013
14747562210,3chrt0-21swapper/008:30:180
144512999218,11cyclictest3056-21PK-Backend10:47:303
144512999217,2cyclictest141rcu_preempt08:05:013
1445129992119,1cyclictest3056-21PK-Backend10:37:553
1445129992119,1cyclictest3056-21PK-Backend09:50:443
1445129992119,1cyclictest3056-21PK-Backend09:11:423
1445129992119,1cyclictest3056-21PK-Backend09:03:053
1445129992119,1cyclictest3056-21PK-Backend08:35:203
1445129992119,1cyclictest3056-21PK-Backend07:45:593
1445129992119,1cyclictest0-21swapper/311:02:143
1445129992119,1cyclictest0-21swapper/310:58:223
1445129992118,2cyclictest3056-21PK-Backend11:20:123
1445129992118,2cyclictest3056-21PK-Backend11:08:033
1445129992118,2cyclictest3056-21PK-Backend08:59:133
1445129992113,6cyclictest883-21dbus-daemon10:25:003
144512999211,17cyclictest1447019-21munin-node12:30:113
144512999210,20cyclictest0-21swapper/310:28:143
144512999210,20cyclictest0-21swapper/310:28:143
144512999210,1cyclictest3056-21PK-Backend11:57:303
144512999210,19cyclictest3056-21PK-Backend10:52:003
144512999210,19cyclictest3056-21PK-Backend09:43:333
1445121992119,1cyclictest0-21swapper/212:14:372
1445121992119,1cyclictest0-21swapper/211:44:012
1445121992119,1cyclictest0-21swapper/211:26:362
1445121992119,1cyclictest0-21swapper/211:20:482
1445121992119,1cyclictest0-21swapper/210:47:442
1445121992119,1cyclictest0-21swapper/210:10:322
1445121992119,1cyclictest0-21swapper/209:50:582
1445121992119,1cyclictest0-21swapper/209:47:402
1445121992119,1cyclictest0-21swapper/208:24:132
1445121992119,1cyclictest0-21swapper/208:24:122
1445121992119,1cyclictest0-21swapper/208:08:512
1445121992119,1cyclictest0-21swapper/207:38:502
144512199210,20cyclictest0-21swapper/212:21:462
144512199210,20cyclictest0-21swapper/211:19:282
144512199210,20cyclictest0-21swapper/211:19:282
144512199210,20cyclictest0-21swapper/208:12:312
1445120992119,1cyclictest0-21swapper/109:18:591
1445120992113,6cyclictest1489552-21sed09:15:021
1445117992119,1cyclictest0-21swapper/012:02:100
1445117992119,1cyclictest0-21swapper/011:56:220
1445117992119,1cyclictest0-21swapper/011:42:490
1445117992119,1cyclictest0-21swapper/011:27:210
1445117992119,1cyclictest0-21swapper/010:57:130
1445117992119,1cyclictest0-21swapper/010:49:290
1445117992119,1cyclictest0-21swapper/009:44:400
1445117992119,1cyclictest0-21swapper/009:27:510
1445117992119,1cyclictest0-21swapper/009:27:500
1445117992119,1cyclictest0-21swapper/007:51:450
1445117992114,5cyclictest1-21systemd11:15:000
144511799210,2cyclictest0-21swapper/011:17:410
144511799210,2cyclictest0-21swapper/011:17:410
144511799210,20cyclictest3056-21PK-Backend10:15:510
144511799210,20cyclictest0-21swapper/012:25:560
144511799210,20cyclictest0-21swapper/012:06:010
144511799210,20cyclictest0-21swapper/010:26:510
144511799210,20cyclictest0-21swapper/010:26:510
144511799210,20cyclictest0-21swapper/010:06:440
144512999202,13cyclictest1540302-21apt11:40:103
1445129992018,1cyclictest3056-21PK-Backend12:14:063
1445129992018,1cyclictest3056-21PK-Backend10:34:023
1445129992018,1cyclictest3056-21PK-Backend08:10:123
1445129992018,1cyclictest0-21swapper/311:38:113
1445129992018,1cyclictest0-21swapper/311:16:213
1445129992018,1cyclictest0-21swapper/311:16:203
1445129992017,2cyclictest1447241-21ls07:15:033
1445129992017,2cyclictest0-21swapper/307:35:183
1445129992013,5cyclictest1538302-21grep11:35:013
1445129992012,6cyclictest1494421-21sshd09:26:373
1445129992012,6cyclictest1494421-21sshd09:26:373
1445129992011,6cyclictest926-21udisksd09:38:033
1445129992011,6cyclictest883-21dbus-daemon07:29:593
144512999200,1cyclictest3056-21PK-Backend12:26:513
144512999200,19cyclictest3056-21PK-Backend10:41:473
144512999200,19cyclictest3056-21PK-Backend09:09:123
144512999200,19cyclictest3056-21PK-Backend08:27:503
144512999200,18cyclictest3056-21PK-Backend08:30:203
1445121992018,1cyclictest0-21swapper/212:30:512
1445121992018,1cyclictest0-21swapper/212:15:592
1445121992018,1cyclictest0-21swapper/212:15:592
1445121992018,1cyclictest0-21swapper/211:51:102
1445121992018,1cyclictest0-21swapper/210:51:022
1445121992018,1cyclictest0-21swapper/210:35:532
1445121992018,1cyclictest0-21swapper/209:35:182
1445121992018,1cyclictest0-21swapper/209:20:572
1445121992018,1cyclictest0-21swapper/207:15:532
1445121992013,5cyclictest1527176-21cat11:00:202
144512199200,1cyclictest0-21swapper/212:00:162
144512199200,19cyclictest0-21swapper/212:36:402
144512199200,19cyclictest0-21swapper/212:29:292
144512199200,19cyclictest0-21swapper/211:30:282
144512199200,19cyclictest0-21swapper/210:58:452
144512199200,19cyclictest0-21swapper/209:32:002
144512199200,19cyclictest0-21swapper/207:53:582
144512199200,19cyclictest0-21swapper/207:47:162
144512199200,19cyclictest0-21swapper/207:44:112
1445120992018,1cyclictest0-21swapper/108:40:181
1445120992013,5cyclictest436-20systemd-journal12:08:361
1445120992013,5cyclictest1-21systemd08:52:351
1445120992012,6cyclictest1556675-21cat12:25:121
1445120992012,6cyclictest1541163-21python311:40:181
1445117992018,1cyclictest3056-21PK-Backend11:20:590
1445117992018,1cyclictest0-21swapper/012:22:030
1445117992018,1cyclictest0-21swapper/012:15:410
1445117992018,1cyclictest0-21swapper/012:15:410
1445117992018,1cyclictest0-21swapper/008:56:150
1445117992018,1cyclictest0-21swapper/007:21:500
1445117992013,5cyclictest1519709-21cat10:40:140
144511799200,19cyclictest0-21swapper/011:50:330
144511799200,19cyclictest0-21swapper/009:07:360
144511799200,19cyclictest0-21swapper/008:41:330
144511799200,19cyclictest0-21swapper/008:27:080
144511799200,19cyclictest0-21swapper/008:18:280
139099200,16rtkit-daemon1445113-21cyclictest11:06:040
139099200,14rtkit-daemon3056-21PK-Backend07:57:283
14908352190,3sleep20-21swapper/209:15:222
1445129991917,1cyclictest3056-21PK-Backend12:07:453
1445129991917,1cyclictest3056-21PK-Backend09:22:183
1445129991917,1cyclictest3056-21PK-Backend08:52:163
1445129991917,1cyclictest0-21swapper/309:30:013
144512999191,16cyclictest1559902-21apt12:35:103
1445129991910,7cyclictest1453809-21users07:30:223
144512999190,1cyclictest3056-21PK-Backend09:17:513
144512999190,1cyclictest3056-21PK-Backend07:50:103
1445121991917,1cyclictest0-21swapper/210:15:462
1445121991917,1cyclictest0-21swapper/209:12:062
1445121991917,1cyclictest0-21swapper/209:00:442
1445121991917,1cyclictest0-21swapper/208:51:372
1445121991917,1cyclictest0-21swapper/207:25:332
1445121991912,5cyclictest1538568-21apt11:35:102
1445121991910,7cyclictest1494311-21users09:25:232
1445121991910,7cyclictest1494311-21users09:25:222
144512199190,1cyclictest0-21swapper/211:47:532
144512199190,1cyclictest0-21swapper/210:03:572
144512199190,1cyclictest0-21swapper/208:26:422
144512199190,1cyclictest0-21swapper/208:18:392
144512199190,1cyclictest0-21swapper/207:22:082
144512199190,18cyclictest0-21swapper/207:30:052
1445120991912,5cyclictest1532083-21cat11:15:171
1445120991912,5cyclictest1532083-21cat11:15:171
1445120991912,5cyclictest1498181-21/usr/sbin/munin09:40:011
1445120991912,5cyclictest1476611-21ntp_kernel_err08:35:181
144512099190,1cyclictest3056-21PK-Backend11:35:391
144512099190,1cyclictest0-21swapper/108:02:001
144512099190,18cyclictest3056-21PK-Backend10:19:211
1445117991917,1cyclictest0-21swapper/012:38:050
1445117991917,1cyclictest0-21swapper/011:33:100
1445117991917,1cyclictest0-21swapper/010:10:030
1445117991917,1cyclictest0-21swapper/009:53:470
1445117991917,1cyclictest0-21swapper/009:46:030
1445117991917,1cyclictest0-21swapper/008:45:250
1445117991917,1cyclictest0-21swapper/008:10:370
1445117991912,2cyclictest13-21ksoftirqd/007:45:000
1445117991910,7cyclictest13-21ksoftirqd/009:40:000
144511799190,1cyclictest0-21swapper/009:18:100
144511799190,1cyclictest0-21swapper/007:49:150
144511799190,18cyclictest0-21swapper/009:59:340
144511799190,18cyclictest0-21swapper/009:20:070
1445129991816,1cyclictest3056-21PK-Backend12:17:583
1445129991816,1cyclictest3056-21PK-Backend12:17:583
1445129991816,1cyclictest3056-21PK-Backend11:14:253
1445129991816,1cyclictest3056-21PK-Backend08:47:503
1445129991816,1cyclictest0-21swapper/310:11:243
1445129991816,1cyclictest0-21swapper/307:41:463
1445129991813,3cyclictest1445792-21irqstats07:10:173
1445121991816,1cyclictest0-21swapper/210:42:302
1445121991816,1cyclictest0-21swapper/208:31:092
1445121991816,1cyclictest0-21swapper/208:04:392
1445121991814,3cyclictest978-21snmpd11:58:262
144512099189,7cyclictest436-20systemd-journal08:50:011
144512099182,12cyclictest1551223-21apt12:10:111
144512099182,12cyclictest1474178-21apt08:30:121
1445120991816,1cyclictest0-21swapper/107:40:021
1445120991813,3cyclictest1525375-21grep10:55:181
1445120991810,6cyclictest1523836-21python310:50:211
1445120991810,6cyclictest1454202-21cron07:35:001
1445120991810,6cyclictest1448999-21cron07:20:001
1445117991816,1cyclictest3056-21PK-Backend10:04:480
1445117991816,1cyclictest0-21swapper/012:34:140
1445117991816,1cyclictest0-21swapper/012:11:490
1445117991816,1cyclictest0-21swapper/011:48:370
1445117991816,1cyclictest0-21swapper/008:54:190
1445117991812,4cyclictest1513380-21cut10:20:210
1445117991812,4cyclictest1451803-21grep07:25:210
1445129991715,1cyclictest3056-21PK-Backend08:18:023
144512999170,3cyclictest14662782sleep308:05:313
1445121991715,1cyclictest0-21swapper/210:33:572
1445121991715,1cyclictest0-21swapper/207:59:192
1445121991710,6cyclictest1507548-21grep10:05:152
144512099179,6cyclictest1534105-21ntpq11:20:201
1445120991715,1cyclictest3056-21PK-Backend11:32:491
1445120991715,1cyclictest0-21swapper/112:30:211
1445120991715,1cyclictest0-21swapper/109:40:491
1445120991714,2cyclictest3056-21PK-Backend07:14:201
1445120991712,3cyclictest1555179-21kernelversion12:20:171
1445120991712,3cyclictest1518420-21needreboot10:35:181
1445120991711,5cyclictest1547535-21cut12:00:021
1445120991711,4cyclictest1516216-21grep10:30:111
1445120991710,6cyclictest1458700-21ntpq07:45:191
1445120991710,5cyclictest1467644-21ntpq08:10:191
144512099170,6cyclictest3056-21PK-Backend09:30:001
144512099170,6cyclictest3056-21PK-Backend09:30:001
1445117991710,6cyclictest13-21ksoftirqd/007:35:220
1445117991710,5cyclictest436-20systemd-journal09:00:370
1445117991710,5cyclictest1527341-21cat11:00:230
1445129991614,1cyclictest3056-21PK-Backend12:24:213
1445129991612,3cyclictest1470688-21/usr/sbin/munin08:20:193
1445129991612,3cyclictest1470688-21/usr/sbin/munin08:20:193
1445121991611,4cyclictest1487890-21grep09:10:022
1445121991610,4cyclictest1504764-21swap09:55:222
144512099169,5cyclictest436-20systemd-journal08:10:001
144512099169,5cyclictest26-21ksoftirqd/109:00:111
144512099169,5cyclictest1483587-21ntpq08:55:191
144512099168,6cyclictest1502680-21which09:50:211
144512099168,6cyclictest1500436-21expr09:45:141
144512099167,8cyclictest1486979-21needreboot09:05:171
1445120991612,3cyclictest1544939-21cut11:50:191
1445120991610,4cyclictest1528840-21strings11:05:181
144512199159,5cyclictest1445281-21seq07:10:052
144512099159,5cyclictest1507928-21cat10:05:191
144512099158,5cyclictest1468650-21dpkg08:15:141
144512099156,7cyclictest1548493-21ntp_states12:00:201
1445120991513,1cyclictest3056-21PK-Backend11:00:251
1445120991513,1cyclictest3056-21PK-Backend07:37:261
1445120991513,1cyclictest0-21swapper/112:35:281
1445120991513,1cyclictest0-21swapper/108:28:231
144512099151,12cyclictest1449395-21cpuspeed_turbos07:20:121
144512099151,11cyclictest1471578-21python308:20:251
144512099151,11cyclictest1471578-21python308:20:251
1445120991510,4cyclictest1491951-21cat09:20:161
144512099150,7cyclictest1515779-21idleruntime-cro10:30:001
144512099150,7cyclictest1515779-21idleruntime-cro10:29:591
144512099150,14cyclictest3056-21PK-Backend07:26:041
144512099150,13cyclictest1530090-21cut11:10:111
144512099150,11cyclictest1095-21runrttasks07:50:041
1445117991512,2cyclictest1446766-21cron07:15:010
1445121991412,1cyclictest0-21swapper/211:11:082
144512099149,3cyclictest1095-21runrttasks11:45:011
1445120991410,3cyclictest3056-21PK-Backend11:25:551
144512099139,3cyclictest3056-21PK-Backend10:20:581
144512099138,4cyclictest3056-21PK-Backend09:34:461
144512099126,5cyclictest1503779-21dpkg09:55:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional