You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-15 - 12:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Sat Aug 15, 2026 00:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
59833322120,8sleep10-21swapper/119:05:241
59905121440,6sleep30-21swapper/319:10:013
64156121170,4sleep13056-21PK-Backend21:09:401
66371221070,4sleep2662899-21/usr/sbin/munin22:10:202
65568521020,2sleep30-21swapper/321:50:003
59880227639,10sleep20-21swapper/219:08:362
59784227246,17sleep00-21swapper/019:05:160
6074122510,2sleep20-21swapper/219:30:172
6531332490,3sleep13056-21PK-Backend21:40:201
6070062490,2sleep00-21swapper/019:30:110
6495222440,2sleep30-21swapper/321:30:153
59905699383,24cyclictest0-21swapper/222:52:192
59905699382,22cyclictest0-21swapper/223:19:052
59905699382,22cyclictest0-21swapper/223:13:402
59905699373,22cyclictest0-21swapper/221:19:362
59905699372,22cyclictest0-21swapper/222:21:432
59905699372,22cyclictest0-21swapper/221:27:422
59905699372,22cyclictest0-21swapper/220:57:382
59905699372,22cyclictest0-21swapper/220:40:422
59905699372,21cyclictest0-21swapper/221:08:292
59905699371,21cyclictest0-21swapper/219:21:022
59905699362,22cyclictest0-21swapper/223:06:342
59905699362,22cyclictest0-21swapper/221:59:222
59905699362,22cyclictest0-21swapper/221:10:052
59905699362,22cyclictest0-21swapper/219:48:372
59905699362,21cyclictest0-21swapper/222:45:292
59905699362,21cyclictest0-21swapper/220:11:472
59905699362,21cyclictest0-21swapper/200:25:102
59905699362,21cyclictest0-21swapper/200:13:512
59905699361,20cyclictest639736-21taskset21:03:292
59905699361,19cyclictest0-21swapper/219:18:102
59905699360,21cyclictest6552892sleep221:47:552
59905699360,21cyclictest615220-21taskset19:53:472
59905699352,23cyclictest0-21swapper/221:37:482
59905699352,21cyclictest0-21swapper/219:42:082
59905699351,21cyclictest0-21swapper/223:47:242
59905699351,18cyclictest0-21swapper/220:25:062
59905699350,20cyclictest694473-21chrt23:37:222
59905699350,20cyclictest0-21swapper/223:42:232
59905699342,23cyclictest0-21swapper/222:29:092
59905699342,23cyclictest0-21swapper/221:44:222
59905699341,18cyclictest0-21swapper/223:26:232
59905699340,21cyclictest0-21swapper/219:55:032
59905699340,19cyclictest708680-21taskset00:18:052
59905699340,19cyclictest699602-21chrt23:51:172
59905699340,19cyclictest660583-21chrt22:04:112
59905699340,19cyclictest0-21swapper/222:33:142
6914482330,2sleep30-21swapper/323:30:013
6371392330,3chrt0-21swapper/020:55:160
59905699332,22cyclictest0-21swapper/222:42:522
59905699331,23cyclictest0-21swapper/219:13:252
59905699330,20cyclictest662332-21chrt22:06:032
59905699330,20cyclictest6241582sleep220:18:572
59905699330,18cyclictest0-21swapper/219:38:252
59905699330,18cyclictest0-21swapper/200:07:092
59905699320,20cyclictest689203-21chrt23:21:342
59905699320,18cyclictest0-21swapper/221:52:522
59905699320,18cyclictest0-21swapper/220:45:392
6245712310,2sleep00-21swapper/020:20:110
59905699311,18cyclictest0-21swapper/222:56:362
59905699311,18cyclictest0-21swapper/222:36:192
59905699310,29cyclictest6822122sleep223:00:492
59905699310,22cyclictest636220-21chrt20:52:572
59905699310,20cyclictest625880-21taskset20:23:502
59905699310,19cyclictest0-21swapper/222:16:382
59905699300,18cyclictest0-21swapper/219:27:162
59905699300,18cyclictest0-21swapper/200:22:372
59905699300,17cyclictest650255-21chrt21:35:002
59905699300,16cyclictest692685-21seq23:31:392
59905699300,16cyclictest629186-21chrt20:31:362
59905699290,18cyclictest618437-21chrt20:00:362
59905699288,18cyclictest712652-21cat00:30:102
59905699280,16cyclictest1095-21runrttasks20:08:072
599053992717,6cyclictest606408-21turbostat.cron19:30:001
139099260,4rtkit-daemon1389-21rtkit-daemon20:20:443
6458272250,3sleep20-21swapper/221:20:162
59905999259,14cyclictest617722-21awk20:00:163
599059992516,7cyclictest710566-21cron00:25:003
59905699251,22cyclictest978-21snmpd00:03:222
59905699242,20cyclictest700400-21apt-get23:55:032
599056992411,11cyclictest715009-21if_enp2s000:35:152
599048992415,7cyclictest678695-21users22:50:220
139099240,2rtkit-daemon3056-21PK-Backend00:06:141
599059992313,7cyclictest623160-21diskstats20:15:143
599059992313,7cyclictest436-20systemd-journal23:55:003
599059992312,9cyclictest657229-21unin-run21:55:003
59905399230,21cyclictest3056-21PK-Backend21:04:391
599059992220,1cyclictest0-21swapper/323:22:203
599059992220,1cyclictest0-21swapper/323:09:293
599059992220,1cyclictest0-21swapper/321:26:213
599059992219,2cyclictest3056-21PK-Backend00:38:253
59905999220,8cyclictest6371382/usr/sbin/munin20:55:163
59905699220,20cyclictest630811-21chrt20:35:262
599053992219,2cyclictest3056-21PK-Backend00:32:111
59905399220,20cyclictest3056-21PK-Backend19:16:031
599048992220,1cyclictest0-21swapper/022:48:410
599048992220,1cyclictest0-21swapper/020:35:590
599048992220,1cyclictest0-21swapper/019:43:330
59904899220,21cyclictest0-21swapper/023:04:020
59904899220,21cyclictest0-21swapper/022:39:420
139099220,16rtkit-daemon3056-21PK-Backend23:52:321
59905999216,11cyclictest883-21dbus-daemon23:59:593
599059992119,1cyclictest0-21swapper/323:11:123
599059992119,1cyclictest0-21swapper/322:40:363
599059992119,1cyclictest0-21swapper/322:38:003
599059992119,1cyclictest0-21swapper/322:14:073
599059992119,1cyclictest0-21swapper/322:05:143
599059992119,1cyclictest0-21swapper/321:37:573
599059992119,1cyclictest0-21swapper/320:44:233
599059992119,1cyclictest0-21swapper/320:06:043
599059992119,1cyclictest0-21swapper/319:41:373
599059992119,1cyclictest0-21swapper/319:26:033
599059992119,1cyclictest0-21swapper/319:17:513
599059992119,1cyclictest0-21swapper/300:26:223
59905999210,20cyclictest0-21swapper/323:39:243
59905999210,20cyclictest0-21swapper/319:49:213
59905999210,19cyclictest0-21swapper/321:10:193
599053992119,1cyclictest3056-21PK-Backend23:39:591
599053992119,1cyclictest3056-21PK-Backend23:31:481
599053992119,1cyclictest3056-21PK-Backend21:50:021
599053992118,2cyclictest3056-21PK-Backend22:22:191
599053992118,2cyclictest3056-21PK-Backend00:21:431
599053992111,7cyclictest664401-21ls22:15:001
59905399210,20cyclictest0-21swapper/100:39:141
59905399210,19cyclictest3056-21PK-Backend23:00:521
59905399210,19cyclictest3056-21PK-Backend21:12:101
59905399210,19cyclictest3056-21PK-Backend19:43:071
599048992119,1cyclictest0-21swapper/023:55:400
599048992119,1cyclictest0-21swapper/023:25:040
599048992119,1cyclictest0-21swapper/023:22:340
599048992119,1cyclictest0-21swapper/023:08:350
599048992119,1cyclictest0-21swapper/022:01:160
599048992119,1cyclictest0-21swapper/021:35:070
599048992119,1cyclictest0-21swapper/021:26:280
599048992119,1cyclictest0-21swapper/021:11:000
599048992119,1cyclictest0-21swapper/019:35:290
599048992119,1cyclictest0-21swapper/019:12:510
599048992119,1cyclictest0-21swapper/000:28:380
599048992119,1cyclictest0-21swapper/000:16:350
599048992119,1cyclictest0-21swapper/000:13:310
599048992119,1cyclictest0-21swapper/000:07:230
599048992119,1cyclictest0-21swapper/000:01:480
59904899210,20cyclictest3056-21PK-Backend23:50:180
59904899210,20cyclictest0-21swapper/023:32:210
59904899210,20cyclictest0-21swapper/022:24:140
59904899210,20cyclictest0-21swapper/021:31:150
139099210,14rtkit-daemon3056-21PK-Backend23:55:351
599059992018,1cyclictest0-21swapper/323:40:183
599059992018,1cyclictest0-21swapper/322:45:163
599059992018,1cyclictest0-21swapper/321:20:063
599059992018,1cyclictest0-21swapper/320:49:103
59905999201,7cyclictest652383-21/usr/sbin/munin21:40:123
599059992017,2cyclictest0-21swapper/323:46:413
59905999201,5cyclictest622509-21cron20:15:003
599059992013,4cyclictest707120-21idleruntime-cro00:15:003
599059992012,6cyclictest679088-21cron22:55:003
59905999200,8cyclictest635674-21ntp_states20:50:193
59905999200,19cyclictest0-21swapper/322:16:443
59905999200,19cyclictest0-21swapper/320:28:423
59905999200,19cyclictest0-21swapper/319:52:123
59905999200,18cyclictest0-21swapper/322:33:203
599053992018,1cyclictest3056-21PK-Backend23:09:311
599053992018,1cyclictest3056-21PK-Backend22:31:461
599053992018,1cyclictest3056-21PK-Backend21:38:391
599053992018,1cyclictest3056-21PK-Backend19:31:451
599053992018,1cyclictest3056-21PK-Backend19:10:301
599053992017,2cyclictest3056-21PK-Backend22:51:051
59905399200,1cyclictest3056-21PK-Backend23:25:531
59905399200,1cyclictest3056-21PK-Backend19:48:221
59905399200,19cyclictest3056-21PK-Backend22:55:591
59905399200,19cyclictest3056-21PK-Backend22:48:491
59905399200,19cyclictest3056-21PK-Backend20:49:521
59905399200,19cyclictest3056-21PK-Backend20:37:561
59905399200,18cyclictest3056-21PK-Backend21:34:271
59905399200,18cyclictest3056-21PK-Backend20:32:561
599048992018,1cyclictest0-21swapper/023:35:250
599048992018,1cyclictest0-21swapper/022:33:340
599048992018,1cyclictest0-21swapper/022:26:510
599048992018,1cyclictest0-21swapper/022:05:080
599048992018,1cyclictest0-21swapper/021:51:090
599048992018,1cyclictest0-21swapper/020:43:150
599048992018,1cyclictest0-21swapper/020:29:160
599048992018,1cyclictest0-21swapper/020:05:440
599048992018,1cyclictest0-21swapper/019:26:300
599048992018,1cyclictest0-21swapper/000:36:290
599048992015,3cyclictest613602-21sh19:50:000
59904899200,1cyclictest0-21swapper/000:20:130
59904899200,19cyclictest0-21swapper/023:10:170
59904899200,19cyclictest0-21swapper/022:59:290
59904899200,19cyclictest0-21swapper/021:41:220
59904899200,19cyclictest0-21swapper/020:53:440
59904899200,19cyclictest0-21swapper/019:19:470
59905999192,12cyclictest608670-21apt19:35:103
599059991917,1cyclictest0-21swapper/321:55:073
599059991917,1cyclictest0-21swapper/319:32:243
599059991917,1cyclictest0-21swapper/300:15:273
599059991917,1cyclictest0-21swapper/300:04:183
599059991911,6cyclictest615997-21which19:55:143
59905999190,1cyclictest0-21swapper/323:25:253
59905999190,1cyclictest0-21swapper/320:33:223
59905999190,1cyclictest0-21swapper/319:12:243
59905999190,1cyclictest0-21swapper/300:07:223
599053991917,1cyclictest3056-21PK-Backend22:16:241
599053991917,1cyclictest3056-21PK-Backend22:04:281
599053991917,1cyclictest3056-21PK-Backend21:47:381
599053991917,1cyclictest3056-21PK-Backend20:44:591
599053991917,1cyclictest3056-21PK-Backend20:27:351
599053991917,1cyclictest3056-21PK-Backend19:53:351
599053991917,1cyclictest0-21swapper/100:00:211
599053991916,2cyclictest3056-21PK-Backend21:22:031
59905399190,18cyclictest3056-21PK-Backend23:13:161
59905399190,18cyclictest3056-21PK-Backend20:20:461
599048991917,1cyclictest0-21swapper/022:42:190
599048991917,1cyclictest0-21swapper/021:56:290
599048991917,1cyclictest0-21swapper/021:48:110
599048991917,1cyclictest0-21swapper/021:19:180
599048991917,1cyclictest0-21swapper/000:32:170
599048991912,5cyclictest621127-21cat20:10:120
59904899190,1cyclictest0-21swapper/022:12:520
59904899190,1cyclictest0-21swapper/021:24:590
59904899190,1cyclictest0-21swapper/021:08:030
59904899190,18cyclictest0-21swapper/020:15:100
59904899190,18cyclictest0-21swapper/020:03:410
59904899190,18cyclictest0-21swapper/019:55:230
139099190,15rtkit-daemon1389-21rtkit-daemon22:27:223
139099190,13rtkit-daemon3056-21PK-Backend23:24:301
6686312180,4sleep13056-21PK-Backend22:25:111
599059991816,1cyclictest0-21swapper/322:03:463
599059991816,1cyclictest0-21swapper/319:24:003
599059991812,5cyclictest687052-21awk23:15:173
599059991810,6cyclictest629715-21find20:35:133
59905999180,1cyclictest0-21swapper/321:18:373
59905999180,16cyclictest712951-21df_inode00:30:133
599053991816,1cyclictest3056-21PK-Backend20:19:181
599053991815,2cyclictest3056-21PK-Backend20:00:111
599053991815,2cyclictest3056-21PK-Backend19:57:471
599053991814,3cyclictest705729-21cpuspeed00:10:091
59905399180,1cyclictest3056-21PK-Backend23:17:011
59905399180,1cyclictest3056-21PK-Backend21:18:451
599048991816,1cyclictest0-21swapper/021:03:160
59904899180,1cyclictest0-21swapper/020:31:190
59905999179,6cyclictest680156-21cut22:55:183
599059991715,1cyclictest0-21swapper/321:01:063
59905999171,12cyclictest666878-21apt-get22:20:043
59905999170,3cyclictest640615-21irqstats21:05:163
59905999170,15cyclictest681092-21apt23:00:123
599053991715,1cyclictest3056-21PK-Backend19:23:131
599053991713,2cyclictest26-21ksoftirqd/120:58:401
59905399170,1cyclictest3056-21PK-Backend19:35:501
599048991715,1cyclictest0-21swapper/023:44:580
599048991715,1cyclictest0-21swapper/022:16:030
599048991714,2cyclictest604675-21sh19:25:010
599048991713,2cyclictest634658-21sh20:49:590
59905399167,8cyclictest3056-21PK-Backend23:50:001
599053991614,1cyclictest3056-21PK-Backend20:07:201
59905399160,15cyclictest3056-21PK-Backend22:39:091
599048991610,5cyclictest687159-21awk23:15:190
599048991610,4cyclictest2156-21gnome-shell19:50:090
599048991610,4cyclictest13-21ksoftirqd/023:47:090
599053991513,1cyclictest3056-21PK-Backend22:08:411
599053991513,1cyclictest3056-21PK-Backend21:57:321
599053991512,2cyclictest3056-21PK-Backend22:41:121
59905399151,11cyclictest648536-21apt21:30:001
59905399149,3cyclictest1095-21runrttasks20:51:291
599053991410,2cyclictest26-21ksoftirqd/100:26:091
59905399136,5cyclictest622325-21seq20:12:411
59905399136,5cyclictest2156-21gnome-shell23:41:091
139099120,4rtkit-daemon3056-21PK-Backend00:15:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional