You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-02 - 13:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Thu Jul 02, 2026 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
101730021030,3sleep2354-21jbd2/sdb2-823:10:162
93009221000,9sleep10-21swapper/119:05:171
93078327840,9sleep30-21swapper/319:06:293
139099740,61rtkit-daemon0-21swapper/019:09:150
93096326343,14sleep20-21swapper/219:08:492
9313752490,4sleep03056-21PK-Backend19:10:110
9629012470,5sleep33056-21PK-Backend20:35:193
10125332450,3sleep20-21swapper/222:55:212
9802722440,2sleep10-21swapper/121:25:131
10035612400,4sleep23056-21PK-Backend22:30:182
10225402390,4sleep20-21swapper/223:25:122
931210993015,9cyclictest1030-21sshd20:50:101
931210992922,5cyclictest1022898-21netstat23:25:171
10409282290,4sleep23056-21PK-Backend00:15:202
931210992615,9cyclictest883-21dbus-daemon20:41:311
931210992416,6cyclictest1020190-21cron23:20:001
931210992415,7cyclictest970816-21cron21:00:001
931210992321,1cyclictest0-21swapper/120:28:211
931210992311,10cyclictest1039727-21cut00:15:011
931205992321,1cyclictest0-21swapper/022:57:130
931216992220,1cyclictest3056-21PK-Backend21:50:453
931216992220,1cyclictest3056-21PK-Backend20:59:213
931216992219,2cyclictest3056-21PK-Backend22:01:533
93121499220,1cyclictest0-21swapper/220:49:422
93121499220,1cyclictest0-21swapper/220:49:412
93121099223,17cyclictest950988-21munin-run20:05:001
931210992220,1cyclictest0-21swapper/123:22:271
931210992220,1cyclictest0-21swapper/120:08:121
931210992218,3cyclictest1004951-21hddtemp_smartct22:35:151
931205992220,1cyclictest0-21swapper/023:42:020
931205992220,1cyclictest0-21swapper/023:36:280
931205992220,1cyclictest0-21swapper/021:12:570
931205992220,1cyclictest0-21swapper/020:59:460
931205992220,1cyclictest0-21swapper/020:40:590
931205992220,1cyclictest0-21swapper/000:10:210
139099220,4rtkit-daemon0-21swapper/122:15:151
931216992119,1cyclictest3056-21PK-Backend23:46:513
931216992119,1cyclictest3056-21PK-Backend22:49:463
931216992119,1cyclictest3056-21PK-Backend21:39:163
931216992119,1cyclictest3056-21PK-Backend21:11:583
931216992119,1cyclictest3056-21PK-Backend20:51:033
931216992119,1cyclictest3056-21PK-Backend00:22:533
931216992119,1cyclictest3056-21PK-Backend00:01:173
931216992119,1cyclictest0-21swapper/319:26:403
931216992119,1cyclictest0-21swapper/319:14:443
931216992119,1cyclictest0-21swapper/300:33:223
931216992118,2cyclictest3056-21PK-Backend23:15:483
931216992118,2cyclictest3056-21PK-Backend23:05:483
931216992118,2cyclictest3056-21PK-Backend22:33:223
931216992118,2cyclictest3056-21PK-Backend21:28:343
931216992113,6cyclictest941449-21sed19:35:223
931216992111,8cyclictest935781-21basename19:20:143
931216992110,9cyclictest3056-21PK-Backend20:45:003
93121699210,20cyclictest3056-21PK-Backend23:44:213
93121699210,20cyclictest3056-21PK-Backend22:50:543
93121699210,19cyclictest3056-21PK-Backend23:13:323
93121699210,19cyclictest3056-21PK-Backend22:12:013
93121699210,19cyclictest3056-21PK-Backend20:47:113
93121699210,19cyclictest3056-21PK-Backend20:47:113
93121699210,19cyclictest3056-21PK-Backend20:34:133
931214992117,3cyclictest9617712sleep220:33:462
93121499210,20cyclictest0-21swapper/219:56:212
93121499210,1cyclictest0-21swapper/222:39:322
93121499210,1cyclictest0-21swapper/221:27:132
93121499210,1cyclictest0-21swapper/220:03:592
93121499210,19cyclictest0-21swapper/222:00:522
93121099219,9cyclictest963645-21unin-run20:40:001
931210992119,1cyclictest3056-21PK-Backend19:37:091
931210992119,1cyclictest0-21swapper/123:38:151
931210992119,1cyclictest0-21swapper/123:30:241
931210992119,1cyclictest0-21swapper/122:54:281
931210992119,1cyclictest0-21swapper/121:16:531
931210992119,1cyclictest0-21swapper/120:23:001
931210992119,1cyclictest0-21swapper/100:19:511
931210992119,1cyclictest0-21swapper/100:03:501
93121099211,11cyclictest26-21ksoftirqd/121:10:111
93121099210,20cyclictest3056-21PK-Backend19:49:271
93121099210,20cyclictest0-21swapper/120:31:591
931205992119,1cyclictest0-21swapper/023:48:450
931205992119,1cyclictest0-21swapper/023:33:580
931205992119,1cyclictest0-21swapper/022:10:020
931205992119,1cyclictest0-21swapper/020:51:280
931205992119,1cyclictest0-21swapper/020:47:360
931205992119,1cyclictest0-21swapper/020:47:360
931205992119,1cyclictest0-21swapper/020:29:510
931205992119,1cyclictest0-21swapper/000:26:230
931205992113,6cyclictest980796-21pluginstate21:25:200
93120599210,20cyclictest0-21swapper/022:47:470
93120599210,20cyclictest0-21swapper/022:00:500
93120599210,20cyclictest0-21swapper/021:46:500
93120599210,20cyclictest0-21swapper/021:36:290
93120599210,20cyclictest0-21swapper/021:24:190
93120599210,20cyclictest0-21swapper/019:17:590
93120599210,20cyclictest0-21swapper/000:08:590
931216992018,1cyclictest3056-21PK-Backend22:43:443
931216992018,1cyclictest3056-21PK-Backend20:08:103
931216992018,1cyclictest3056-21PK-Backend20:03:513
931216992018,1cyclictest0-21swapper/321:32:183
93121699201,7cyclictest1047863-21python300:35:213
931216992017,2cyclictest3056-21PK-Backend20:30:003
93121699200,1cyclictest3056-21PK-Backend22:56:553
93121699200,1cyclictest0-21swapper/319:30:593
93121699200,19cyclictest3056-21PK-Backend21:58:283
93121699200,19cyclictest3056-21PK-Backend21:49:023
93121699200,19cyclictest3056-21PK-Backend21:09:213
93121699200,18cyclictest3056-21PK-Backend22:17:493
931214992018,1cyclictest0-21swapper/223:56:252
931214992018,1cyclictest0-21swapper/222:51:362
931214992018,1cyclictest0-21swapper/222:25:272
931214992018,1cyclictest0-21swapper/222:17:222
931214992018,1cyclictest0-21swapper/220:05:072
931214992015,4cyclictest944197-21tr19:45:132
931214992015,3cyclictest955145-21cpuspeed_turbos20:15:142
93121499200,19cyclictest1389-21rtkit-daemon00:38:552
93121499200,19cyclictest0-21swapper/223:51:592
93121499200,19cyclictest0-21swapper/221:16:462
93121499200,19cyclictest0-21swapper/221:12:402
93121499200,19cyclictest0-21swapper/219:22:082
93121499200,19cyclictest0-21swapper/219:17:152
93121499200,19cyclictest0-21swapper/200:01:252
931210992018,1cyclictest3056-21PK-Backend19:16:351
931210992018,1cyclictest3056-21PK-Backend00:38:031
931210992018,1cyclictest0-21swapper/123:52:281
931210992018,1cyclictest0-21swapper/123:44:221
931210992018,1cyclictest0-21swapper/122:28:391
931210992018,1cyclictest0-21swapper/122:11:021
931210992018,1cyclictest0-21swapper/121:49:321
931210992018,1cyclictest0-21swapper/121:42:561
931210992018,1cyclictest0-21swapper/121:42:551
931210992012,7cyclictest995022-21smartctl22:05:201
931210992012,5cyclictest436-20systemd-journal23:00:001
93121099200,19cyclictest0-21swapper/123:03:541
93121099200,19cyclictest0-21swapper/122:46:431
93121099200,19cyclictest0-21swapper/122:40:081
93121099200,19cyclictest0-21swapper/122:20:351
93121099200,19cyclictest0-21swapper/121:51:141
93121099200,19cyclictest0-21swapper/121:24:111
93121099200,19cyclictest0-21swapper/119:57:381
931205992019,1cyclictest0-21swapper/023:07:480
931205992018,1cyclictest0-21swapper/023:50:400
931205992018,1cyclictest0-21swapper/019:57:270
931205992018,1cyclictest0-21swapper/019:42:180
931205992012,6cyclictest960845-21cat20:30:150
931205992012,6cyclictest1021963-21pluginstate23:25:000
93120599200,1cyclictest0-21swapper/022:29:420
93120599200,1cyclictest0-21swapper/021:19:060
93120599200,19cyclictest3056-21PK-Backend19:32:390
93120599200,19cyclictest0-21swapper/022:15:500
93120599200,19cyclictest0-21swapper/021:06:490
93120599200,19cyclictest0-21swapper/019:37:460
93120599200,19cyclictest0-21swapper/019:20:430
139099200,14rtkit-daemon0-21swapper/019:55:000
9540782190,4sleep23056-21PK-Backend20:10:202
931216991917,1cyclictest3056-21PK-Backend22:29:033
931216991917,1cyclictest3056-21PK-Backend21:20:433
931216991917,1cyclictest3056-21PK-Backend20:18:113
931216991916,2cyclictest3056-21PK-Backend00:12:063
93121699190,1cyclictest3056-21PK-Backend23:59:213
93121699190,1cyclictest3056-21PK-Backend23:37:383
93121699190,1cyclictest3056-21PK-Backend23:03:303
93121699190,1cyclictest3056-21PK-Backend22:37:433
93121699190,1cyclictest3056-21PK-Backend20:14:463
93121699190,1cyclictest3056-21PK-Backend00:28:413
93121699190,1cyclictest0-21swapper/319:16:063
93121699190,18cyclictest3056-21PK-Backend23:52:253
93121499193,11cyclictest942285-21apt19:40:122
931214991917,1cyclictest0-21swapper/219:11:132
931214991916,2cyclictest3056-21PK-Backend20:55:362
931214991914,4cyclictest34-21ksoftirqd/221:30:162
931214991914,3cyclictest984961-21sh21:39:592
931214991914,3cyclictest1027128-21sh23:39:592
931214991913,5cyclictest968826-21apt-get20:55:002
931214991911,6cyclictest937989-21sed19:25:202
931214991911,6cyclictest1046013-21ntp_states00:30:182
93121499190,1cyclictest3056-21PK-Backend23:40:162
93121499190,1cyclictest0-21swapper/222:46:082
93121499190,1cyclictest0-21swapper/222:40:412
93121499190,1cyclictest0-21swapper/221:57:282
93121499190,18cyclictest0-21swapper/223:15:222
93121499190,18cyclictest0-21swapper/223:03:052
93121499190,18cyclictest0-21swapper/222:06:192
93121499190,18cyclictest0-21swapper/219:30:472
93121499190,18cyclictest0-21swapper/200:07:332
931210991917,1cyclictest0-21swapper/123:47:271
931210991917,1cyclictest0-21swapper/123:06:451
931210991917,1cyclictest0-21swapper/121:04:371
931210991917,1cyclictest0-21swapper/100:32:161
931210991917,1cyclictest0-21swapper/100:28:581
931210991914,3cyclictest993664-21gpgv22:05:011
931210991913,5cyclictest1037573-21systemctl00:10:011
93121099190,1cyclictest3056-21PK-Backend21:31:071
93121099190,1cyclictest3056-21PK-Backend19:20:411
93121099190,1cyclictest0-21swapper/123:56:541
93121099190,1cyclictest0-21swapper/100:24:181
93121099190,18cyclictest0-21swapper/120:45:581
93121099190,18cyclictest0-21swapper/120:45:581
93120599195,12cyclictest950988-21unin-run20:05:000
931205991918,1cyclictest0-21swapper/021:04:460
931205991917,1cyclictest0-21swapper/022:36:520
931205991917,1cyclictest0-21swapper/022:09:280
931205991917,1cyclictest0-21swapper/021:33:180
931205991917,1cyclictest0-21swapper/020:24:310
931205991917,1cyclictest0-21swapper/000:16:090
931205991912,5cyclictest956696-21sed20:20:000
931205991912,5cyclictest1014803-21date23:05:010
93120599190,1cyclictest0-21swapper/021:40:490
93120599190,1cyclictest0-21swapper/021:40:490
93120599190,1cyclictest0-21swapper/000:20:340
93120599190,18cyclictest0-21swapper/022:54:560
93120599190,18cyclictest0-21swapper/021:57:250
93120599190,18cyclictest0-21swapper/000:37:250
93120599190,18cyclictest0-21swapper/000:02:030
139099190,13rtkit-daemon0-21swapper/019:45:250
10446122190,9sleep234-21ksoftirqd/200:25:232
931216991816,1cyclictest3056-21PK-Backend00:15:583
931216991816,1cyclictest3056-21PK-Backend00:08:143
931216991816,1cyclictest0-21swapper/319:40:533
931216991815,2cyclictest3056-21PK-Backend22:09:243
93121699181,15cyclictest944667-21/usr/sbin/munin19:45:173
931214991816,1cyclictest0-21swapper/221:46:332
931214991816,1cyclictest0-21swapper/220:44:552
931214991816,1cyclictest0-21swapper/200:23:222
931214991812,4cyclictest979749-21dump-pmu-power21:25:012
931210991816,1cyclictest3056-21PK-Backend19:32:031
931210991813,4cyclictest26-21ksoftirqd/120:20:011
93121099181,13cyclictest946020-21apt19:50:121
931205991816,1cyclictest0-21swapper/020:08:350
931205991811,6cyclictest1018113-21seq23:14:030
931205991811,6cyclictest1003004-21expr22:30:120
93120599180,1cyclictest0-21swapper/023:57:360
9570812170,3sleep33056-21PK-Backend20:20:113
931216991715,1cyclictest3056-21PK-Backend21:44:093
931216991715,1cyclictest3056-21PK-Backend21:44:093
931216991710,6cyclictest1021942-21ls23:25:013
93121699170,3cyclictest972096-21ntp_states21:00:183
93121499179,6cyclictest971459-21sort21:00:122
931214991715,1cyclictest0-21swapper/220:36:172
931214991715,1cyclictest0-21swapper/200:11:252
931214991710,5cyclictest1-21systemd23:10:002
93121099179,6cyclictest984122-21ls21:35:181
93121099179,6cyclictest973536-21cat21:05:151
93121099172,10cyclictest952682-21apt-get20:10:041
931210991714,2cyclictest3056-21PK-Backend19:26:221
931210991712,3cyclictest1003670-21rt-features22:30:201
93121099170,3cyclictest3056-21PK-Backend19:15:001
931205991715,1cyclictest0-21swapper/022:42:540
931205991712,4cyclictest1046153-21grep00:30:210
931205991711,4cyclictest963619-21munin-run20:40:000
931205991710,5cyclictest988893-21tr21:50:120
931216991613,2cyclictest3056-21PK-Backend22:22:083
931216991610,5cyclictest1023861-21grep23:30:003
93121499169,6cyclictest941015-21cat19:35:162
931214991614,1cyclictest0-21swapper/223:46:252
931214991614,1cyclictest0-21swapper/221:42:142
931214991614,1cyclictest0-21swapper/221:42:142
931214991614,1cyclictest0-21swapper/221:06:312
931214991614,1cyclictest0-21swapper/220:24:472
931214991611,3cyclictest996430-21latency22:10:162
931214991610,4cyclictest34-21ksoftirqd/219:51:302
931210991614,1cyclictest3056-21PK-Backend19:42:311
931210991611,3cyclictest991906-21munin-plugin-st22:00:001
931210991610,4cyclictest26-21ksoftirqd/123:10:151
93120599161,11cyclictest953184-21apt-get20:10:040
931205991610,5cyclictest1022523-21ls23:25:120
931205991610,4cyclictest2156-21gnome-shell22:21:080
931205991610,4cyclictest1019346-21cat23:15:160
93120599160,1cyclictest0-21swapper/019:26:580
931216991513,1cyclictest3056-21PK-Backend23:34:003
931216991513,1cyclictest3056-21PK-Backend19:54:253
93121499157,6cyclictest0-21swapper/223:21:092
931214991510,4cyclictest999472-21ls22:20:132
931214991510,3cyclictest958820-21cpuspeed_turbos20:25:122
931214991510,3cyclictest2156-21gnome-shell23:31:082
93121699140,12cyclictest949027-21chrt19:57:383
93121499149,4cyclictest990186-21basename21:55:002
93121699135,7cyclictest977221-21needreboot21:15:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional