You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-06 - 18:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Mon Jul 06, 2026 12:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
350357721270,3sleep20-21swapper/208:15:132
349349121250,4sleep30-21swapper/307:45:153
351253721060,4sleep33056-21PK-Backend08:40:003
355700621050,4sleep13056-21PK-Backend10:45:141
139099870,52rtkit-daemon0-21swapper/107:06:541
347996227841,14sleep20-21swapper/207:08:302
347901627444,20sleep00-21swapper/007:05:180
347987426539,20sleep30-21swapper/307:07:223
35729462490,4sleep13056-21PK-Backend11:30:131
35612012450,2sleep13056-21PK-Backend10:55:201
34983672440,2sleep30-21swapper/308:00:113
139099380,4rtkit-daemon3056-21PK-Backend11:57:451
139099370,3rtkit-daemon3056-21PK-Backend07:50:341
139099360,3rtkit-daemon3056-21PK-Backend11:43:591
139099360,3rtkit-daemon3056-21PK-Backend10:51:441
3480221992823,3cyclictest26-21ksoftirqd/108:29:401
35184882270,2sleep00-21swapper/008:55:130
348022499270,13cyclictest3489528-21cat07:35:022
348022499250,12cyclictest35778072cat11:45:002
3480229992315,6cyclictest3500888-21python308:05:203
3480229992315,6cyclictest3500888-21python308:05:203
348022999231,19cyclictest0-21swapper/309:40:123
3480224992314,7cyclictest3556362-21cron10:45:012
348022199230,21cyclictest3505593-21df_inode08:20:141
348022999223,6cyclictest1-21systemd08:15:003
3480229992220,1cyclictest0-21swapper/312:30:553
3480229992220,1cyclictest0-21swapper/310:24:553
3480229992220,1cyclictest0-21swapper/310:19:143
3480229992220,1cyclictest0-21swapper/309:48:183
3480229992214,7cyclictest42-21ksoftirqd/309:55:213
348022499224,16cyclictest3510350-21cat08:30:212
3480224992220,1cyclictest0-21swapper/212:08:032
3480224992220,1cyclictest0-21swapper/208:57:012
3480224992215,5cyclictest883-21dbus-daemon12:30:012
348022499221,10cyclictest35414772netstat10:00:172
348022499221,10cyclictest35414772netstat10:00:172
348022499220,21cyclictest0-21swapper/209:12:012
3480221992220,1cyclictest0-21swapper/111:15:291
3480221992219,2cyclictest3056-21PK-Backend12:34:161
3480219992220,1cyclictest0-21swapper/010:51:540
3480219992220,1cyclictest0-21swapper/009:42:520
3480219992220,1cyclictest0-21swapper/009:05:350
3480219992220,1cyclictest0-21swapper/008:41:360
3480219992220,1cyclictest0-21swapper/007:28:140
3480219992220,1cyclictest0-21swapper/007:21:190
139099220,14rtkit-daemon0-21swapper/107:15:041
348022999219,10cyclictest3582542-21python311:55:233
3480229992119,1cyclictest0-21swapper/312:27:513
3480229992119,1cyclictest0-21swapper/312:05:403
3480229992119,1cyclictest0-21swapper/311:29:033
3480229992119,1cyclictest0-21swapper/311:20:453
3480229992119,1cyclictest0-21swapper/310:39:153
3480229992119,1cyclictest0-21swapper/309:53:463
3480229992118,2cyclictest3056-21PK-Backend07:40:293
348022999211,7cyclictest3552303-21python310:30:223
348022999210,20cyclictest0-21swapper/312:01:083
348022999210,20cyclictest0-21swapper/311:47:023
348022999210,20cyclictest0-21swapper/311:39:043
348022999210,1cyclictest0-21swapper/309:38:253
3480224992119,1cyclictest0-21swapper/212:18:442
3480224992119,1cyclictest0-21swapper/211:56:412
3480224992119,1cyclictest0-21swapper/211:45:392
3480224992119,1cyclictest0-21swapper/211:20:102
3480224992119,1cyclictest0-21swapper/209:40:062
3480224992119,1cyclictest0-21swapper/209:38:312
3480224992119,1cyclictest0-21swapper/209:24:052
3480224992119,1cyclictest0-21swapper/209:16:342
3480224992119,1cyclictest0-21swapper/209:00:452
3480224992119,1cyclictest0-21swapper/209:00:452
3480224992119,1cyclictest0-21swapper/207:21:152
3480224992119,1cyclictest0-21swapper/207:16:422
3480224992119,1cyclictest0-21swapper/207:12:572
3480224992115,5cyclictest3554663-21systemd-run10:40:002
3480224992115,4cyclictest3543978-21idleruntime-cro10:10:002
348022199213,16cyclictest3537052-21idleruntime-cro09:50:001
3480221992119,1cyclictest3056-21PK-Backend12:28:351
3480221992119,1cyclictest3056-21PK-Backend12:11:391
3480221992119,1cyclictest3056-21PK-Backend12:09:361
3480221992119,1cyclictest3056-21PK-Backend11:38:261
3480221992119,1cyclictest3056-21PK-Backend10:27:081
3480221992119,1cyclictest3056-21PK-Backend08:30:551
3480221992119,1cyclictest0-21swapper/111:12:581
3480221992119,1cyclictest0-21swapper/108:40:011
3480221992116,3cyclictest3524892-21sh09:15:001
3480221992115,5cyclictest3519939-21/usr/sbin/munin09:00:171
3480221992115,5cyclictest3519939-21/usr/sbin/munin09:00:171
348022199210,20cyclictest3056-21PK-Backend10:34:591
348022199210,20cyclictest3056-21PK-Backend10:13:231
348022199210,19cyclictest3056-21PK-Backend12:35:181
348022199210,19cyclictest3056-21PK-Backend12:21:391
348022199210,19cyclictest3056-21PK-Backend10:40:331
3480219992119,1cyclictest3056-21PK-Backend08:52:230
3480219992119,1cyclictest0-21swapper/012:24:070
3480219992119,1cyclictest0-21swapper/011:58:250
3480219992119,1cyclictest0-21swapper/011:37:370
3480219992119,1cyclictest0-21swapper/011:24:190
3480219992119,1cyclictest0-21swapper/010:32:280
3480219992119,1cyclictest0-21swapper/010:23:080
3480219992119,1cyclictest0-21swapper/010:14:160
3480219992119,1cyclictest0-21swapper/009:50:500
3480219992119,1cyclictest0-21swapper/009:47:250
3480219992119,1cyclictest0-21swapper/009:34:340
3480219992119,1cyclictest0-21swapper/008:05:520
3480219992119,1cyclictest0-21swapper/008:05:520
3480219992119,1cyclictest0-21swapper/007:58:160
3480219992118,2cyclictest0-21swapper/007:37:130
348021999210,20cyclictest0-21swapper/011:52:510
348021999210,20cyclictest0-21swapper/011:18:170
348021999210,20cyclictest0-21swapper/010:16:050
348021999210,20cyclictest0-21swapper/009:58:070
348021999210,20cyclictest0-21swapper/009:35:230
348021999210,20cyclictest0-21swapper/008:04:170
348022999203,15cyclictest3544864-21df10:10:123
3480229992012,6cyclictest3528626-21awk09:25:093
348022999201,17cyclictest3488709-21python307:30:203
348022999200,1cyclictest3056-21PK-Backend11:13:293
348022999200,19cyclictest3056-21PK-Backend07:13:193
348022999200,19cyclictest0-21swapper/311:41:483
348022999200,19cyclictest0-21swapper/311:03:283
348022999200,19cyclictest0-21swapper/310:45:033
348022999200,19cyclictest0-21swapper/310:43:483
348022999200,19cyclictest0-21swapper/309:30:073
348022999200,19cyclictest0-21swapper/309:18:033
348022999200,19cyclictest0-21swapper/309:03:513
348022999200,19cyclictest0-21swapper/309:03:513
348022999200,19cyclictest0-21swapper/308:28:223
348022999200,19cyclictest0-21swapper/308:22:483
348022999200,19cyclictest0-21swapper/308:15:043
348022999200,19cyclictest0-21swapper/307:18:263
348022499202,13cyclictest3508874-21apparmor_parser08:29:382
3480224992018,1cyclictest0-21swapper/212:23:032
3480224992018,1cyclictest0-21swapper/212:11:212
3480224992018,1cyclictest0-21swapper/211:36:132
3480224992018,1cyclictest0-21swapper/210:57:262
3480224992018,1cyclictest0-21swapper/208:51:052
3480224992018,1cyclictest0-21swapper/207:28:592
3480224992013,5cyclictest3573987-21sshd11:32:172
3480224992012,6cyclictest883-21dbus-daemon07:45:002
348022499200,1cyclictest0-21swapper/212:39:262
348022499200,1cyclictest0-21swapper/212:01:132
348022499200,1cyclictest0-21swapper/210:46:032
348022499200,19cyclictest0-21swapper/208:06:052
348022499200,19cyclictest0-21swapper/208:06:052
348022499200,19cyclictest0-21swapper/207:58:262
348022499200,19cyclictest0-21swapper/207:52:252
3480221992018,1cyclictest3056-21PK-Backend11:08:111
3480221992018,1cyclictest3056-21PK-Backend09:17:331
3480221992018,1cyclictest3056-21PK-Backend09:06:441
3480221992018,1cyclictest0-21swapper/108:47:521
3480221992018,1cyclictest0-21swapper/107:45:411
3480221992018,1cyclictest0-21swapper/107:11:341
3480221992017,2cyclictest3056-21PK-Backend08:02:021
348022199200,1cyclictest3056-21PK-Backend07:55:261
348022199200,1cyclictest0-21swapper/108:56:301
348022199200,19cyclictest3056-21PK-Backend09:31:191
348022199200,19cyclictest0-21swapper/111:20:011
348022199200,18cyclictest3056-21PK-Backend07:29:171
3480219992018,1cyclictest0-21swapper/012:38:130
3480219992018,1cyclictest0-21swapper/012:04:000
3480219992018,1cyclictest0-21swapper/011:30:200
3480219992018,1cyclictest0-21swapper/011:12:150
3480219992018,1cyclictest0-21swapper/011:08:300
3480219992018,1cyclictest0-21swapper/011:01:000
3480219992018,1cyclictest0-21swapper/010:46:200
3480219992018,1cyclictest0-21swapper/009:27:520
3480219992018,1cyclictest0-21swapper/009:04:470
3480219992018,1cyclictest0-21swapper/009:04:470
3480219992018,1cyclictest0-21swapper/008:45:550
3480219992018,1cyclictest0-21swapper/008:39:250
3480219992018,1cyclictest0-21swapper/008:33:030
3480219992018,1cyclictest0-21swapper/007:48:490
348021999200,1cyclictest0-21swapper/007:10:160
348021999200,19cyclictest3056-21PK-Backend07:16:450
348021999200,19cyclictest0-21swapper/012:30:160
348021999200,19cyclictest0-21swapper/012:28:130
348021999200,19cyclictest0-21swapper/012:10:350
348021999200,19cyclictest0-21swapper/011:25:340
348021999200,19cyclictest0-21swapper/010:08:000
348021999200,19cyclictest0-21swapper/010:01:460
348021999200,19cyclictest0-21swapper/010:01:450
348021999200,19cyclictest0-21swapper/009:21:090
348021999200,19cyclictest0-21swapper/009:11:290
348021999200,19cyclictest0-21swapper/008:28:170
3480229991912,6cyclictest3542895-21awk10:05:133
3480229991912,5cyclictest436-20systemd-journal07:50:173
348022999191,16cyclictest3560750-21/usr/sbin/munin10:55:153
3480229991911,6cyclictest3517697-21cron08:54:593
348022999190,1cyclictest0-21swapper/311:18:153
348022999190,1cyclictest0-21swapper/310:52:543
348022999190,1cyclictest0-21swapper/309:21:493
348022999190,1cyclictest0-21swapper/307:58:083
348022999190,18cyclictest0-21swapper/311:30:193
348022999190,18cyclictest0-21swapper/310:26:103
348022999190,18cyclictest0-21swapper/309:11:223
348022499199,3cyclictest34-21ksoftirqd/208:22:182
348022499194,6cyclictest34-21ksoftirqd/211:14:162
3480224991917,1cyclictest0-21swapper/211:52:082
3480224991917,1cyclictest0-21swapper/210:12:322
3480224991917,1cyclictest0-21swapper/209:46:152
3480224991917,1cyclictest0-21swapper/209:30:132
3480224991917,1cyclictest0-21swapper/208:40:512
3480224991917,1cyclictest0-21swapper/208:13:482
3480224991917,1cyclictest0-21swapper/207:49:002
3480224991916,2cyclictest331rcuc/207:38:462
3480224991916,2cyclictest1095-21runrttasks09:58:252
3480224991914,4cyclictest978-21snmpd10:22:172
3480224991912,5cyclictest3563208-21sshd11:00:432
348022499190,7cyclictest34-21ksoftirqd/211:19:592
348022499190,1cyclictest0-21swapper/212:34:192
348022499190,1cyclictest0-21swapper/210:52:532
348022499190,1cyclictest0-21swapper/208:03:402
3480221991917,1cyclictest3056-21PK-Backend11:48:141
3480221991917,1cyclictest3056-21PK-Backend09:43:421
3480221991917,1cyclictest3056-21PK-Backend09:20:301
3480221991917,1cyclictest3056-21PK-Backend08:06:011
3480221991917,1cyclictest3056-21PK-Backend08:06:011
3480221991917,1cyclictest3056-21PK-Backend07:22:351
3480221991917,1cyclictest0-21swapper/112:15:441
348022199190,1cyclictest3056-21PK-Backend09:57:421
348022199190,1cyclictest3056-21PK-Backend08:14:541
348022199190,18cyclictest3056-21PK-Backend10:02:071
348022199190,18cyclictest3056-21PK-Backend10:02:071
348022199190,18cyclictest3056-21PK-Backend08:15:411
3480219991917,1cyclictest0-21swapper/012:06:160
3480219991917,1cyclictest0-21swapper/011:41:360
3480219991917,1cyclictest0-21swapper/010:38:150
3480219991917,1cyclictest0-21swapper/008:24:190
3480219991917,1cyclictest0-21swapper/007:43:490
3480219991912,5cyclictest3503293-21date08:15:000
3480219991910,8cyclictest3489338-21unin-run07:35:000
348021999190,1cyclictest3056-21PK-Backend10:26:260
348021999190,18cyclictest0-21swapper/009:15:140
3480229991816,1cyclictest0-21swapper/312:19:263
3480229991815,2cyclictest3056-21PK-Backend08:48:443
348022999181,15cyclictest3595945-21hddtemp_smartct12:35:163
348022999181,15cyclictest3587242-21df_inode12:10:133
348022999181,13cyclictest3486110-21apt07:25:123
348022999180,7cyclictest3591602-21seq12:22:363
3480224991816,1cyclictest0-21swapper/211:25:112
3480224991816,1cyclictest0-21swapper/209:54:062
3480224991816,1cyclictest0-21swapper/208:48:082
3480224991811,5cyclictest3522063-21df09:05:132
348022499180,1cyclictest0-21swapper/211:08:412
3480221991816,1cyclictest3056-21PK-Backend11:26:501
3480221991816,1cyclictest3056-21PK-Backend10:16:001
3480221991816,1cyclictest3056-21PK-Backend10:06:331
3480221991816,1cyclictest3056-21PK-Backend09:25:371
3480221991816,1cyclictest0-21swapper/111:50:431
3480221991815,2cyclictest3056-21PK-Backend11:01:081
3480219991816,1cyclictest0-21swapper/010:57:290
3480219991816,1cyclictest0-21swapper/008:17:230
3480219991811,5cyclictest3590230-21grep12:20:010
35479722170,3sleep13056-21PK-Backend10:20:121
3480229991715,1cyclictest0-21swapper/310:03:533
3480229991715,1cyclictest0-21swapper/310:03:533
3480229991715,1cyclictest0-21swapper/309:07:363
3480229991713,3cyclictest42-21ksoftirqd/311:50:133
348022999171,12cyclictest3484377-21apt07:20:103
3480229991710,5cyclictest3564544-21ntpq11:05:173
348022999170,15cyclictest3509698-21hddtemp_smartct08:30:153
348022499178,7cyclictest436-20systemd-journal08:40:002
3480224991715,1cyclictest0-21swapper/210:30:422
3480224991715,1cyclictest0-21swapper/210:25:422
3480224991715,1cyclictest0-21swapper/210:17:582
3480224991715,1cyclictest0-21swapper/209:25:402
3480221991715,1cyclictest3056-21PK-Backend09:36:251
3480221991711,5cyclictest3490139-21cat07:35:171
3480219991715,1cyclictest0-21swapper/010:41:470
3480219991715,1cyclictest0-21swapper/007:51:270
348022999165,9cyclictest42-21ksoftirqd/308:40:203
3480229991614,1cyclictest3056-21PK-Backend08:57:223
348021999167,8cyclictest3579680-21munin-plugin-st11:50:000
348022199157,2cyclictest26-21ksoftirqd/108:40:021
3480221991511,2cyclictest26-21ksoftirqd/108:50:131
348022199151,10cyclictest3491366-21apt07:40:121
3480221991510,4cyclictest3056-21PK-Backend12:01:401
3480229991410,3cyclictest3056-21PK-Backend07:38:053
3480221991410,2cyclictest26-21ksoftirqd/109:54:371
3480221991410,2cyclictest26-21ksoftirqd/107:32:231
348022199131,10cyclictest3554033-21python310:35:211
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional