You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-16 - 20:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Thu Apr 16, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
376756721110,4sleep23056-21PK-Backend08:00:202
38413102940,4sleep20-21swapper/211:30:162
374757328670,9sleep00-21swapper/007:05:190
374723727244,20sleep20-21swapper/207:05:142
374822026944,17sleep30-21swapper/307:07:073
374835326445,14sleep10-21swapper/107:08:511
38238862510,4sleep00-21swapper/010:40:140
38238862510,4sleep00-21swapper/010:40:140
37667112470,3sleep13056-21PK-Backend08:00:111
139099370,4rtkit-daemon3056-21PK-Backend11:33:511
139099370,3rtkit-daemon3056-21PK-Backend12:02:131
139099360,3rtkit-daemon3056-21PK-Backend12:33:101
38449642330,1sleep23844966-21grep11:40:182
139099260,4rtkit-daemon1389-21rtkit-daemon07:54:163
37648312250,5chrt0-21swapper/007:55:010
139099250,4rtkit-daemon1389-21rtkit-daemon08:53:172
3748589992418,5cyclictest3056-21PK-Backend10:48:113
3748589992416,6cyclictest3865104-21cron12:40:003
3748589992416,6cyclictest3865104-21cron12:40:003
3748589992320,2cyclictest3056-21PK-Backend12:26:183
3748584992313,7cyclictest3781075-21cron08:40:001
38401862220,4sleep30-21swapper/311:25:243
3748589992220,1cyclictest0-21swapper/312:30:593
3748589992220,1cyclictest0-21swapper/311:20:353
3748589992220,1cyclictest0-21swapper/308:01:273
3748589992219,2cyclictest3056-21PK-Backend10:59:473
3748589992219,2cyclictest3056-21PK-Backend09:25:033
3748586992220,1cyclictest0-21swapper/212:19:272
3748586992220,1cyclictest0-21swapper/209:37:312
3748586992220,1cyclictest0-21swapper/209:37:312
3748586992220,1cyclictest0-21swapper/209:13:452
3748584992220,1cyclictest0-21swapper/109:55:261
3748584992220,1cyclictest0-21swapper/109:21:061
3748584992219,2cyclictest3056-21PK-Backend11:40:241
3748584992219,2cyclictest3056-21PK-Backend10:42:381
3748584992219,2cyclictest3056-21PK-Backend10:42:381
374858499220,21cyclictest3056-21PK-Backend08:49:421
3748579992220,1cyclictest3056-21PK-Backend12:30:030
3748579992220,1cyclictest0-21swapper/011:19:260
3748579992220,1cyclictest0-21swapper/011:04:310
3748579992220,1cyclictest0-21swapper/009:21:300
3748579992220,1cyclictest0-21swapper/008:42:580
3748579992220,1cyclictest0-21swapper/008:42:580
3748579992220,1cyclictest0-21swapper/008:23:310
3748579992219,2cyclictest0-21swapper/012:29:010
139099220,4rtkit-daemon1389-21rtkit-daemon10:09:432
139099220,18rtkit-daemon1009-21lldpd10:13:483
139099220,14rtkit-daemon3056-21PK-Backend11:45:421
374858999216,12cyclictest3816347-21unin-run10:20:013
3748589992119,1cyclictest3056-21PK-Backend09:17:393
3748589992119,1cyclictest0-21swapper/312:17:473
3748589992119,1cyclictest0-21swapper/312:01:303
3748589992119,1cyclictest0-21swapper/311:45:023
3748589992119,1cyclictest0-21swapper/311:31:223
3748589992119,1cyclictest0-21swapper/311:12:383
3748589992119,1cyclictest0-21swapper/311:06:423
3748589992119,1cyclictest0-21swapper/310:06:533
3748589992119,1cyclictest0-21swapper/309:02:393
3748589992119,1cyclictest0-21swapper/308:33:313
3748589992119,1cyclictest0-21swapper/308:05:533
3748589992118,2cyclictest3056-21PK-Backend11:36:163
374858999210,20cyclictest0-21swapper/310:41:423
374858999210,20cyclictest0-21swapper/310:41:413
374858999210,20cyclictest0-21swapper/309:54:373
374858999210,19cyclictest0-21swapper/308:15:073
3748586992119,1cyclictest0-21swapper/211:47:292
3748586992119,1cyclictest0-21swapper/211:26:542
3748586992119,1cyclictest0-21swapper/211:04:032
3748586992119,1cyclictest0-21swapper/210:55:042
3748586992119,1cyclictest0-21swapper/210:48:072
3748586992119,1cyclictest0-21swapper/209:54:332
3748586992119,1cyclictest0-21swapper/209:45:072
3748586992119,1cyclictest0-21swapper/209:42:312
3748586992119,1cyclictest0-21swapper/209:31:082
3748586992119,1cyclictest0-21swapper/209:19:462
3748586992119,1cyclictest0-21swapper/207:11:502
3748586992115,5cyclictest3822630-21rt-features10:35:222
3748586992113,6cyclictest3860161-21apt12:25:092
374858699210,20cyclictest0-21swapper/211:13:012
374858699210,20cyclictest0-21swapper/209:22:232
374858699210,20cyclictest0-21swapper/207:43:482
374858699210,20cyclictest0-21swapper/207:27:052
3748584992119,1cyclictest3056-21PK-Backend11:28:481
3748584992119,1cyclictest3056-21PK-Backend11:18:131
3748584992119,1cyclictest3056-21PK-Backend10:39:001
3748584992119,1cyclictest3056-21PK-Backend10:23:251
3748584992119,1cyclictest3056-21PK-Backend09:02:411
3748584992119,1cyclictest3056-21PK-Backend07:29:591
3748584992119,1cyclictest0-21swapper/109:37:361
3748584992119,1cyclictest0-21swapper/109:37:351
3748584992119,1cyclictest0-21swapper/107:54:551
374858499210,20cyclictest3056-21PK-Backend11:55:391
374858499210,19cyclictest3056-21PK-Backend08:54:301
3748579992119,1cyclictest3056-21PK-Backend12:10:090
3748579992119,1cyclictest0-21swapper/011:57:310
3748579992119,1cyclictest0-21swapper/011:47:450
3748579992119,1cyclictest0-21swapper/011:38:590
3748579992119,1cyclictest0-21swapper/010:16:130
3748579992119,1cyclictest0-21swapper/010:03:070
3748579992119,1cyclictest0-21swapper/009:57:540
3748579992119,1cyclictest0-21swapper/009:07:040
3748579992119,1cyclictest0-21swapper/008:28:370
3748579992119,1cyclictest0-21swapper/007:39:230
3748579992119,1cyclictest0-21swapper/007:33:010
3748579992119,1cyclictest0-21swapper/007:29:030
3748579992119,1cyclictest0-21swapper/007:19:570
3748579992118,2cyclictest3056-21PK-Backend07:20:450
3748579992114,5cyclictest3845762-21cron11:45:000
374857999210,20cyclictest0-21swapper/011:29:120
374857999210,20cyclictest0-21swapper/011:20:280
374857999210,20cyclictest0-21swapper/010:50:400
374857999210,20cyclictest0-21swapper/009:44:010
374857999210,20cyclictest0-21swapper/009:12:040
374857999210,20cyclictest0-21swapper/007:49:110
374858999207,11cyclictest1207-21cron10:25:013
3748589992018,1cyclictest0-21swapper/311:52:463
3748589992018,1cyclictest0-21swapper/309:47:483
3748589992018,1cyclictest0-21swapper/308:46:303
3748589992018,1cyclictest0-21swapper/308:35:423
3748589992018,1cyclictest0-21swapper/307:36:403
3748589992018,1cyclictest0-21swapper/307:10:043
3748589992017,2cyclictest3786569-21/usr/sbin/munin08:55:143
3748589992017,2cyclictest3056-21PK-Backend09:08:273
3748589992017,2cyclictest0-21swapper/312:05:233
3748589992012,6cyclictest436-20systemd-journal07:26:063
374858999201,17cyclictest3770420-21apt08:10:113
374858999200,19cyclictest3056-21PK-Backend09:23:263
374858999200,19cyclictest3056-21PK-Backend08:43:333
374858999200,19cyclictest3056-21PK-Backend08:43:333
374858999200,19cyclictest0-21swapper/309:59:513
374858999200,19cyclictest0-21swapper/309:41:453
374858999200,19cyclictest0-21swapper/307:46:143
374858999200,18cyclictest0-21swapper/312:11:053
3748586992018,1cyclictest0-21swapper/212:30:002
3748586992018,1cyclictest0-21swapper/212:20:282
3748586992018,1cyclictest0-21swapper/211:58:182
3748586992018,1cyclictest0-21swapper/211:37:422
3748586992018,1cyclictest0-21swapper/210:52:002
3748586992018,1cyclictest0-21swapper/210:30:302
3748586992018,1cyclictest0-21swapper/210:27:402
3748586992018,1cyclictest0-21swapper/210:24:482
3748586992018,1cyclictest0-21swapper/210:12:522
3748586992018,1cyclictest0-21swapper/207:49:352
3748586992018,1cyclictest0-21swapper/207:37:262
3748586992012,6cyclictest3751901-21sed07:15:212
374858699200,1cyclictest0-21swapper/209:06:082
374858699200,1cyclictest0-21swapper/209:00:192
374858699200,19cyclictest3056-21PK-Backend08:20:252
374858699200,19cyclictest0-21swapper/211:52:232
374858699200,19cyclictest0-21swapper/210:41:382
374858699200,19cyclictest0-21swapper/210:41:382
374858699200,19cyclictest0-21swapper/209:26:212
374858699200,19cyclictest0-21swapper/208:46:342
374858699200,19cyclictest0-21swapper/208:40:392
374858699200,19cyclictest0-21swapper/208:40:382
374858699200,19cyclictest0-21swapper/208:39:502
374858699200,19cyclictest0-21swapper/207:55:372
3748584992018,1cyclictest3056-21PK-Backend12:12:411
3748584992018,1cyclictest3056-21PK-Backend11:09:291
3748584992018,1cyclictest3056-21PK-Backend10:02:151
3748584992018,1cyclictest3056-21PK-Backend09:34:241
3748584992018,1cyclictest0-21swapper/110:59:411
3748584992018,1cyclictest0-21swapper/110:53:461
3748584992018,1cyclictest0-21swapper/110:48:051
3748584992018,1cyclictest0-21swapper/109:17:421
3748584992018,1cyclictest0-21swapper/108:21:371
374858499200,19cyclictest3056-21PK-Backend12:15:321
374858499200,19cyclictest3056-21PK-Backend11:24:561
374858499200,19cyclictest3056-21PK-Backend09:52:501
374858499200,19cyclictest3056-21PK-Backend08:05:221
374858499200,19cyclictest3056-21PK-Backend07:12:501
374858499200,19cyclictest0-21swapper/110:05:411
374858499200,19cyclictest0-21swapper/108:43:011
374858499200,19cyclictest0-21swapper/108:43:001
374858499200,19cyclictest0-21swapper/108:29:291
3748579992018,1cyclictest0-21swapper/012:37:340
3748579992018,1cyclictest0-21swapper/012:37:330
3748579992018,1cyclictest0-21swapper/012:15:490
3748579992018,1cyclictest0-21swapper/012:06:170
3748579992018,1cyclictest0-21swapper/011:31:150
3748579992018,1cyclictest0-21swapper/011:13:310
3748579992018,1cyclictest0-21swapper/009:02:040
3748579992018,1cyclictest0-21swapper/008:36:290
3748579992018,1cyclictest0-21swapper/008:09:180
374857999200,1cyclictest3056-21PK-Backend08:32:090
374857999200,19cyclictest0-21swapper/010:57:350
374857999200,19cyclictest0-21swapper/010:30:110
374857999200,19cyclictest0-21swapper/009:46:390
374857999200,19cyclictest0-21swapper/008:45:550
374857999200,19cyclictest0-21swapper/008:19:120
374857999200,19cyclictest0-21swapper/007:56:000
374857999200,18cyclictest3826700-21cron10:50:000
3748589991917,1cyclictest3056-21PK-Backend09:13:273
3748589991917,1cyclictest0-21swapper/311:57:383
3748589991917,1cyclictest0-21swapper/307:58:513
3748589991917,1cyclictest0-21swapper/307:30:193
3748589991917,1cyclictest0-21swapper/307:22:353
3748589991913,4cyclictest2156-21gnome-shell11:42:093
3748589991911,6cyclictest3809806-21cat10:00:153
374858999191,16cyclictest3750984-21/usr/sbin/munin07:15:153
374858999190,1cyclictest0-21swapper/310:30:333
374858999190,1cyclictest0-21swapper/310:25:533
374858999190,18cyclictest0-21swapper/312:20:373
3748586991917,1cyclictest0-21swapper/212:37:312
3748586991917,1cyclictest0-21swapper/212:37:302
3748586991917,1cyclictest0-21swapper/211:22:012
3748586991917,1cyclictest0-21swapper/211:07:062
3748586991917,1cyclictest0-21swapper/210:18:192
3748586991917,1cyclictest0-21swapper/207:30:162
3748586991915,3cyclictest978-21snmpd07:21:312
3748586991913,5cyclictest3855133-21if_enp2s012:10:142
3748586991913,5cyclictest3771471-21sed08:10:212
3748586991912,6cyclictest3763226-21apt07:50:102
3748586991912,5cyclictest3851565-21ls12:00:122
374858699190,1cyclictest0-21swapper/212:08:512
374858699190,1cyclictest0-21swapper/208:32:012
374858699190,1cyclictest0-21swapper/208:19:362
3748584991917,1cyclictest3056-21PK-Backend11:52:471
3748584991917,1cyclictest3056-21PK-Backend11:01:451
3748584991917,1cyclictest3056-21PK-Backend07:57:301
3748584991917,1cyclictest3056-21PK-Backend07:17:431
3748584991917,1cyclictest0-21swapper/111:36:331
3748584991917,1cyclictest0-21swapper/109:09:161
3748584991917,1cyclictest0-21swapper/107:49:541
3748584991916,2cyclictest3056-21PK-Backend07:35:351
3748584991911,6cyclictest3778277-21which08:30:161
374858499190,1cyclictest3056-21PK-Backend10:27:031
374858499190,1cyclictest3056-21PK-Backend07:30:481
374858499190,1cyclictest0-21swapper/112:26:411
374858499190,18cyclictest3056-21PK-Backend11:10:301
374858499190,18cyclictest0-21swapper/109:45:131
3748579991917,1cyclictest0-21swapper/012:02:240
3748579991917,1cyclictest0-21swapper/009:51:520
3748579991917,1cyclictest0-21swapper/008:00:250
3748579991912,5cyclictest3797119-21grep09:25:120
374857999190,1cyclictest0-21swapper/007:11:250
374857999190,18cyclictest3056-21PK-Backend10:20:520
37758512180,2sleep20-21swapper/208:25:112
3748589991814,2cyclictest3836387-21ntp_states11:15:203
3748589991810,6cyclictest3831539-21sshd11:00:243
3748589991810,6cyclictest3799355-21cat09:30:173
374858999180,16cyclictest3775641-21munin-run08:25:013
374858699189,7cyclictest3808226-21memory09:55:172
374858699188,9cyclictest3788069-21munin-run09:00:002
3748586991816,1cyclictest0-21swapper/211:16:052
3748586991813,4cyclictest34-21ksoftirqd/208:10:012
3748586991811,5cyclictest436-20systemd-journal10:05:002
3748584991816,1cyclictest3056-21PK-Backend12:38:511
3748584991816,1cyclictest3056-21PK-Backend12:38:511
3748584991816,1cyclictest3056-21PK-Backend09:26:411
3748584991816,1cyclictest3056-21PK-Backend07:24:401
3748584991816,1cyclictest0-21swapper/108:19:271
3748584991811,5cyclictest3792277-21cut09:10:151
3748579991816,1cyclictest0-21swapper/009:18:050
3748579991816,1cyclictest0-21swapper/008:10:200
3748579991812,5cyclictest3785770-21sed08:50:210
3748579991811,5cyclictest3812579-21apt-get10:10:000
374857999180,1cyclictest3056-21PK-Backend08:57:040
3748589991715,1cyclictest3056-21PK-Backend10:51:013
374858999171,3cyclictest0-21swapper/308:25:173
3748589991713,3cyclictest978-21snmpd08:52:463
3748589991712,3cyclictest3760241-21kernelversion07:40:143
3748589991710,5cyclictest3821973-21grep10:35:133
3748584991715,1cyclictest3056-21PK-Backend10:31:421
3748584991715,1cyclictest3056-21PK-Backend08:11:381
3748584991710,5cyclictest3802709-21ls09:40:171
3748579991715,1cyclictest3056-21PK-Backend10:10:590
3748579991715,1cyclictest0-21swapper/012:24:210
3748579991715,1cyclictest0-21swapper/011:07:370
3748579991715,1cyclictest0-21swapper/009:35:030
3748579991715,1cyclictest0-21swapper/009:35:020
3748579991715,1cyclictest0-21swapper/009:30:160
374858999160,3cyclictest3801200-21ntp_states09:35:203
374858999160,3cyclictest3801200-21ntp_states09:35:203
3748584991614,1cyclictest3056-21PK-Backend12:09:521
3748579991614,1cyclictest0-21swapper/010:26:340
3748579991613,2cyclictest3056-21PK-Backend10:35:520
374858499159,4cyclictest3786737-21cpuspeed_turbos08:55:121
374857999158,5cyclictest3760034-21expr07:40:120
3748579991513,1cyclictest0-21swapper/011:53:390
3748584991412,1cyclictest0-21swapper/110:10:551
3748584991411,2cyclictest3056-21PK-Backend12:23:031
3748584991411,2cyclictest3056-21PK-Backend10:17:581
374858499139,3cyclictest3056-21PK-Backend07:41:471
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional