You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-18 - 07:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Sat Jul 18, 2026 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
164015821330,3sleep00-21swapper/019:30:210
171375721190,3sleep33056-21PK-Backend23:00:123
170336421100,4sleep23056-21PK-Backend22:30:122
170692421050,2sleep00-21swapper/022:40:120
168734721000,4sleep33056-21PK-Backend21:45:143
139099930,60rtkit-daemon0-21swapper/219:08:522
162987828047,23sleep00-21swapper/019:05:110
163030826443,13sleep30-21swapper/319:05:193
163125926344,13sleep10-21swapper/119:08:501
16446322460,2sleep00-21swapper/019:45:130
16912452380,4sleep00-21swapper/021:55:170
16890162300,3sleep20-21swapper/221:50:142
1631491992814,12cyclictest1663688-21unin-run20:40:002
1631485992816,9cyclictest1715000-21unin-run23:05:000
1631487992613,11cyclictest1683238-21dump-pmu-power21:35:011
1631495992419,3cyclictest436-20systemd-journal19:34:563
163149599241,18cyclictest0-21swapper/319:35:113
1631485992420,3cyclictest1095-21runrttasks20:18:380
1631485992416,6cyclictest1672306-21cron21:05:000
1631485992416,6cyclictest1641705-21python319:35:190
1631495992321,1cyclictest0-21swapper/323:24:143
1631491992320,2cyclictest0-21swapper/200:09:542
163148799234,4cyclictest26-21ksoftirqd/121:50:001
163148799233,17cyclictest436-20systemd-journal22:59:591
1631487992316,3cyclictest26-21ksoftirqd/120:30:001
1631487992314,7cyclictest1648528-21ntp_states19:55:211
1631487992313,8cyclictest1676075-21unin-run21:15:001
1631487992311,10cyclictest26-21ksoftirqd/120:15:001
1631485992321,1cyclictest0-21swapper/022:36:280
1631485992321,1cyclictest0-21swapper/022:21:260
139099230,16rtkit-daemon3056-21PK-Backend20:17:493
139099230,15rtkit-daemon3056-21PK-Backend21:20:132
139099230,15rtkit-daemon3056-21PK-Backend19:53:343
16781802220,7sleep342-21ksoftirqd/321:20:113
1631495992220,1cyclictest0-21swapper/323:15:353
1631495992220,1cyclictest0-21swapper/300:39:313
1631495992219,2cyclictest3056-21PK-Backend20:30:153
163149599220,20cyclictest3056-21PK-Backend21:43:163
163149599220,20cyclictest0-21swapper/323:40:573
1631491992220,1cyclictest0-21swapper/223:47:512
1631491992220,1cyclictest0-21swapper/222:55:522
1631491992220,1cyclictest0-21swapper/221:38:262
1631491992220,1cyclictest0-21swapper/220:21:332
1631491992220,1cyclictest0-21swapper/220:10:452
1631491992219,2cyclictest0-21swapper/219:26:382
1631491992216,4cyclictest1718419-21cron23:15:002
1631491992216,4cyclictest1718419-21cron23:15:002
163149199220,21cyclictest0-21swapper/222:47:072
1631487992220,1cyclictest0-21swapper/123:03:521
1631487992219,2cyclictest3056-21PK-Backend20:35:011
163148599220,21cyclictest0-21swapper/022:50:260
163148599220,21cyclictest0-21swapper/022:07:130
163148599220,21cyclictest0-21swapper/021:53:480
139099220,7rtkit-daemon0-21swapper/222:16:392
139099220,15rtkit-daemon3056-21PK-Backend21:39:093
1631495992119,1cyclictest3056-21PK-Backend19:24:243
1631495992119,1cyclictest0-21swapper/321:34:303
1631495992119,1cyclictest0-21swapper/300:16:333
1631495992118,2cyclictest3056-21PK-Backend23:07:113
1631495992118,2cyclictest3056-21PK-Backend21:04:223
1631495992118,2cyclictest3056-21PK-Backend20:02:113
1631495992113,6cyclictest436-20systemd-journal23:14:553
1631495992113,6cyclictest436-20systemd-journal23:14:553
163149599210,20cyclictest0-21swapper/323:48:143
163149599210,20cyclictest0-21swapper/323:26:243
163149599210,19cyclictest3056-21PK-Backend19:47:023
1631491992119,1cyclictest0-21swapper/223:53:452
1631491992119,1cyclictest0-21swapper/223:36:482
1631491992119,1cyclictest0-21swapper/223:19:182
1631491992119,1cyclictest0-21swapper/222:11:112
1631491992119,1cyclictest0-21swapper/222:11:112
1631491992119,1cyclictest0-21swapper/222:08:412
1631491992119,1cyclictest0-21swapper/221:08:382
1631491992119,1cyclictest0-21swapper/221:03:172
1631491992119,1cyclictest0-21swapper/220:31:272
1631491992119,1cyclictest0-21swapper/220:26:472
1631491992119,1cyclictest0-21swapper/219:50:442
1631491992119,1cyclictest0-21swapper/219:44:222
163149199210,20cyclictest0-21swapper/223:56:422
163149199210,20cyclictest0-21swapper/222:44:232
163149199210,20cyclictest0-21swapper/200:38:132
163149199210,20cyclictest0-21swapper/200:26:302
163149199210,20cyclictest0-21swapper/200:23:192
1631487992119,1cyclictest0-21swapper/122:42:561
1631487992119,1cyclictest0-21swapper/121:50:511
1631487992119,1cyclictest0-21swapper/121:42:401
1631487992119,1cyclictest0-21swapper/119:47:291
1631487992119,1cyclictest0-21swapper/119:39:581
1631487992119,1cyclictest0-21swapper/119:18:231
1631487992119,1cyclictest0-21swapper/119:18:231
1631487992119,1cyclictest0-21swapper/100:09:561
1631487992115,4cyclictest26-21ksoftirqd/122:30:011
1631487992113,6cyclictest1736097-21fwupdmgr00:02:301
163148799210,20cyclictest0-21swapper/123:38:531
163148799210,20cyclictest0-21swapper/100:19:291
163148799210,19cyclictest3056-21PK-Backend23:31:161
1631485992119,1cyclictest0-21swapper/000:05:290
163148599210,20cyclictest0-21swapper/021:44:150
163148599210,20cyclictest0-21swapper/021:27:180
163148599210,20cyclictest0-21swapper/020:54:400
163148599210,20cyclictest0-21swapper/020:11:070
163148599210,20cyclictest0-21swapper/020:08:370
163148599210,20cyclictest0-21swapper/020:08:370
163148599210,20cyclictest0-21swapper/019:56:070
139099210,14rtkit-daemon3056-21PK-Backend20:08:133
139099210,14rtkit-daemon3056-21PK-Backend20:08:133
139099210,14rtkit-daemon0-21swapper/219:55:162
17240842200,15chrt13-21ksoftirqd/023:30:010
1631495992018,1cyclictest3056-21PK-Backend23:38:473
1631495992018,1cyclictest3056-21PK-Backend22:42:113
1631495992018,1cyclictest3056-21PK-Backend22:35:343
1631495992018,1cyclictest3056-21PK-Backend21:58:433
1631495992018,1cyclictest3056-21PK-Backend21:11:263
1631495992018,1cyclictest3056-21PK-Backend00:10:513
1631495992018,1cyclictest0-21swapper/323:51:593
1631495992018,1cyclictest0-21swapper/322:09:043
1631495992018,1cyclictest0-21swapper/322:02:213
1631495992018,1cyclictest0-21swapper/320:42:453
1631495992017,2cyclictest3056-21PK-Backend20:28:533
1631495992014,4cyclictest0-21swapper/300:20:033
163149599200,1cyclictest3056-21PK-Backend20:11:093
163149599200,19cyclictest3056-21PK-Backend22:53:593
163149599200,19cyclictest3056-21PK-Backend22:24:593
163149599200,19cyclictest3056-21PK-Backend21:16:453
163149599200,19cyclictest0-21swapper/323:31:313
163149599200,19cyclictest0-21swapper/320:35:363
163149599200,19cyclictest0-21swapper/319:11:273
163149599200,18cyclictest3056-21PK-Backend20:21:103
163149199209,9cyclictest1640691-21latency_hist19:35:002
1631491992018,1cyclictest0-21swapper/223:20:052
1631491992018,1cyclictest0-21swapper/223:01:542
1631491992018,1cyclictest0-21swapper/222:21:112
1631491992018,1cyclictest0-21swapper/221:47:592
1631491992018,1cyclictest0-21swapper/221:43:462
1631491992018,1cyclictest0-21swapper/221:16:292
1631491992018,1cyclictest0-21swapper/220:08:162
1631491992018,1cyclictest0-21swapper/220:08:152
1631491992018,1cyclictest0-21swapper/219:47:332
1631491992018,1cyclictest0-21swapper/219:13:142
1631491992018,1cyclictest0-21swapper/200:17:582
1631491992013,5cyclictest1668114-21ntpq20:50:202
1631491992011,7cyclictest1664998-21users20:40:232
163149199200,1cyclictest0-21swapper/220:00:582
163149199200,19cyclictest0-21swapper/223:44:052
163149199200,19cyclictest0-21swapper/223:06:332
163149199200,19cyclictest0-21swapper/222:53:092
163149199200,19cyclictest0-21swapper/222:26:112
163149199200,19cyclictest0-21swapper/219:21:442
163149199200,19cyclictest0-21swapper/219:17:052
163149199200,19cyclictest0-21swapper/219:17:052
163149199200,19cyclictest0-21swapper/200:12:512
1631487992018,1cyclictest0-21swapper/122:33:511
1631487992018,1cyclictest0-21swapper/122:16:131
1631487992018,1cyclictest0-21swapper/122:05:321
1631487992018,1cyclictest0-21swapper/120:07:431
1631487992018,1cyclictest0-21swapper/120:07:431
1631487992018,1cyclictest0-21swapper/120:00:401
1631487992018,1cyclictest0-21swapper/119:24:581
1631487992018,1cyclictest0-21swapper/100:14:491
163148799200,19cyclictest3056-21PK-Backend23:43:471
163148799200,19cyclictest3056-21PK-Backend23:17:511
163148799200,19cyclictest3056-21PK-Backend21:25:501
163148799200,19cyclictest3056-21PK-Backend00:20:171
163148799200,19cyclictest0-21swapper/122:46:141
163148799200,19cyclictest0-21swapper/122:13:431
163148799200,19cyclictest0-21swapper/122:13:431
163148799200,19cyclictest0-21swapper/100:33:151
163148799200,18cyclictest3056-21PK-Backend23:45:091
163148799200,18cyclictest3056-21PK-Backend00:25:251
1631485992018,1cyclictest0-21swapper/023:35:000
1631485992018,1cyclictest0-21swapper/023:16:560
1631485992018,1cyclictest0-21swapper/023:11:490
1631485992018,1cyclictest0-21swapper/023:11:490
1631485992018,1cyclictest0-21swapper/020:24:260
1631485992015,4cyclictest1669265-21tr20:55:130
1631485992014,4cyclictest2156-21gnome-shell21:47:090
1631485992012,6cyclictest883-21dbus-daemon20:30:000
163148599200,19cyclictest0-21swapper/023:21:150
163148599200,19cyclictest0-21swapper/019:44:580
163148599200,19cyclictest0-21swapper/000:38:140
163148599200,19cyclictest0-21swapper/000:32:060
163148599200,19cyclictest0-21swapper/000:14:420
139099200,14rtkit-daemon3056-21PK-Backend22:46:553
139099200,13rtkit-daemon3056-21PK-Backend22:29:133
139099200,13rtkit-daemon3056-21PK-Backend00:34:203
163149599198,9cyclictest1680451-21needreboot21:25:183
1631495991917,1cyclictest3056-21PK-Backend19:17:493
1631495991917,1cyclictest3056-21PK-Backend19:17:493
1631495991917,1cyclictest0-21swapper/320:50:093
1631495991917,1cyclictest0-21swapper/320:45:033
1631495991917,1cyclictest0-21swapper/319:29:193
1631495991917,1cyclictest0-21swapper/300:25:383
163149599190,1cyclictest3056-21PK-Backend22:57:173
163149599190,1cyclictest3056-21PK-Backend00:02:133
163149599190,18cyclictest3056-21PK-Backend22:30:343
163149599190,18cyclictest3056-21PK-Backend22:18:513
163149599190,18cyclictest3056-21PK-Backend00:06:323
1631491991917,1cyclictest0-21swapper/223:33:512
1631491991917,1cyclictest0-21swapper/219:36:052
1631491991917,1cyclictest0-21swapper/200:04:472
163149199190,1cyclictest0-21swapper/222:37:002
163149199190,18cyclictest0-21swapper/221:30:142
1631487991917,1cyclictest3056-21PK-Backend23:58:471
1631487991917,1cyclictest3056-21PK-Backend23:53:201
1631487991917,1cyclictest3056-21PK-Backend00:39:091
1631487991917,1cyclictest0-21swapper/123:05:141
1631487991917,1cyclictest0-21swapper/122:37:421
1631487991917,1cyclictest0-21swapper/121:15:231
1631487991917,1cyclictest0-21swapper/119:13:561
1631487991913,5cyclictest1674408-21cut21:10:001
1631487991912,6cyclictest1643456-21awk19:40:201
1631487991912,5cyclictest1678211-21expr21:20:111
163148799190,1cyclictest3056-21PK-Backend19:30:111
163148799190,1cyclictest0-21swapper/122:24:381
163148799190,18cyclictest0-21swapper/120:20:001
163148599199,8cyclictest1697409-21unin-run22:15:000
163148599199,8cyclictest1697409-21unin-run22:15:000
1631485991917,1cyclictest3056-21PK-Backend22:01:050
1631485991917,1cyclictest3056-21PK-Backend00:01:110
1631485991917,1cyclictest0-21swapper/023:40:070
1631485991917,1cyclictest0-21swapper/022:55:060
1631485991917,1cyclictest0-21swapper/022:49:040
1631485991917,1cyclictest0-21swapper/021:22:320
1631485991917,1cyclictest0-21swapper/020:40:080
1631485991917,1cyclictest0-21swapper/020:31:010
1631485991917,1cyclictest0-21swapper/019:21:120
1631485991917,1cyclictest0-21swapper/019:19:500
1631485991917,1cyclictest0-21swapper/019:19:500
1631485991917,1cyclictest0-21swapper/000:26:450
1631485991913,5cyclictest1701693-21seq22:25:170
1631485991913,5cyclictest1638845-21apt19:30:010
163148599190,1cyclictest0-21swapper/021:37:130
139099190,3rtkit-daemon0-21swapper/200:35:012
139099190,13rtkit-daemon0-21swapper/220:15:392
1631495991811,6cyclictest1734111-21sed23:55:203
163149599180,16cyclictest1695918-21apt22:10:113
163149599180,16cyclictest1695918-21apt22:10:113
1631491991816,1cyclictest0-21swapper/221:12:512
1631491991810,6cyclictest1723147-21ntpq23:25:192
1631487991816,1cyclictest3056-21PK-Backend20:48:391
1631487991816,1cyclictest0-21swapper/121:59:371
1631487991816,1cyclictest0-21swapper/120:52:591
1631487991816,1cyclictest0-21swapper/120:40:141
1631487991816,1cyclictest0-21swapper/120:22:301
1631487991813,3cyclictest16373462chrt19:25:051
1631487991812,5cyclictest26-21ksoftirqd/122:50:161
1631487991810,6cyclictest1672326-21apt-get21:05:011
163148799180,1cyclictest3056-21PK-Backend23:13:451
163148799180,1cyclictest3056-21PK-Backend23:13:451
1631485991816,1cyclictest3056-21PK-Backend00:19:010
1631485991816,1cyclictest0-21swapper/022:15:520
1631485991816,1cyclictest0-21swapper/020:04:580
1631485991816,1cyclictest0-21swapper/019:50:330
1631485991811,5cyclictest1742425-21cpuspeed00:20:130
163148599180,1cyclictest0-21swapper/021:11:040
1631491991715,1cyclictest3056-21PK-Backend21:55:152
1631491991715,1cyclictest0-21swapper/222:02:322
1631487991712,3cyclictest17216792sleep123:22:201
1631485991715,1cyclictest0-21swapper/023:56:500
1631485991715,1cyclictest0-21swapper/023:53:530
1631485991715,1cyclictest0-21swapper/021:19:270
1631485991715,1cyclictest0-21swapper/019:12:060
1631485991712,3cyclictest1715718-21kernelversion23:05:160
1631485991711,4cyclictest2156-21gnome-shell22:30:090
1631495991614,1cyclictest3056-21PK-Backend21:54:313
1631495991614,1cyclictest3056-21PK-Backend20:55:163
1631495991610,4cyclictest1673550-21awk21:05:183
163149199169,5cyclictest1681607-21date21:30:012
163149199168,6cyclictest1-21systemd20:49:132
1631487991614,1cyclictest0-21swapper/120:55:151
163148599167,8cyclictest1683245-21perf21:35:000
1631485991614,1cyclictest0-21swapper/023:46:360
1631485991614,1cyclictest0-21swapper/023:35:480
1631485991614,1cyclictest0-21swapper/020:38:580
1631485991612,3cyclictest1674319-21latency_hist21:09:590
163148799155,3cyclictest26-21ksoftirqd/122:01:081
163148799155,3cyclictest26-21ksoftirqd/119:50:021
1631495991410,3cyclictest3056-21PK-Backend19:42:233
163148799149,3cyclictest16632972chrt20:35:351
163148799143,2cyclictest141rcu_preempt23:27:181
1631487991410,2cyclictest26-21ksoftirqd/121:35:051
163148599147,5cyclictest1667351-21date20:50:010
163149199139,3cyclictest1670069-21timerandwakeup20:55:232
163149599120,11cyclictest3056-21PK-Backend19:55:393
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional