You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-12 - 11:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Thu Mar 12, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21087992623,3cyclictest0-21swapper/321:26:043
2108799260,22cyclictest32658-21ssh22:27:373
2108799260,0cyclictest14720-21diskmemload22:39:473
21077992617,8cyclictest0-21swapper/122:46:451
21082992523,1cyclictest23511-21sh00:22:002
21082992520,4cyclictest0-21swapper/222:08:012
21082992520,0cyclictest0-21swapper/223:05:172
2108299250,2cyclictest31321-21ssh23:59:302
2108299250,24cyclictest20637-21sh23:48:592
2107799250,1cyclictest0-21swapper/123:57:441
2107399250,24cyclictest0-21swapper/021:29:060
2108799240,24cyclictest14720-21diskmemload00:28:473
2108799240,23cyclictest14720-21diskmemload00:01:053
2108799240,23cyclictest0-21swapper/321:18:463
2108799240,0cyclictest0-21swapper/322:23:303
21082992422,1cyclictest0-21swapper/223:41:382
2108299240,2cyclictest18067-21sh22:14:222
2108299240,23cyclictest29203-21ssh00:27:472
2108299240,23cyclictest0-21swapper/222:27:012
2108299240,0cyclictest14720-21diskmemload21:42:362
21077992422,1cyclictest14720-21diskmemload21:36:451
21077992422,1cyclictest13372-21sh00:12:291
21077992422,1cyclictest0-21swapper/122:53:091
21077992421,2cyclictest538-21ssh00:01:261
2107799240,2cyclictest28518-21ssh21:53:521
2107799240,24cyclictest0-21swapper/122:33:551
2107799240,24cyclictest0-21swapper/121:59:541
2107799240,24cyclictest0-21swapper/121:59:541
2107799240,24cyclictest0-21swapper/100:15:031
2107799240,23cyclictest20575-21sh23:17:521
2107799240,23cyclictest19012-21ssh22:15:241
2107799240,23cyclictest14720-21diskmemload22:09:301
2107799240,23cyclictest0-21swapper/122:44:031
2107799240,1cyclictest14720-21diskmemload23:34:071
21073992423,1cyclictest728-21sh00:31:520
21073992421,2cyclictest24352-21ssh00:23:230
2107399240,24cyclictest14720-21diskmemload23:30:490
2107399240,24cyclictest0-21swapper/022:52:460
2107399240,24cyclictest0-21swapper/022:42:470
2107399240,23cyclictest25109-21perf20:25:010
2107399240,23cyclictest21345-21ssh23:18:590
2107399240,23cyclictest17052-21ssh21:42:140
2107399240,23cyclictest14720-21diskmemload21:53:180
2107399240,23cyclictest14720-21diskmemload21:36:450
2107399240,23cyclictest14720-21diskmemload21:23:070
2107399240,23cyclictest14720-21diskmemload00:26:480
2107399240,23cyclictest0-21swapper/000:13:060
21087992323,0cyclictest0-21swapper/323:30:453
21087992323,0cyclictest0-21swapper/323:12:103
21087992323,0cyclictest0-21swapper/322:51:293
21087992323,0cyclictest0-21swapper/321:52:303
21087992321,1cyclictest0-21swapper/323:08:563
21087992321,1cyclictest0-21swapper/323:02:173
21087992320,2cyclictest23677-21sh21:49:223
2108799231,1cyclictest0-21swapper/300:07:063
2108799230,23cyclictest0-21swapper/323:56:263
2108799230,23cyclictest0-21swapper/300:33:063
2108799230,23cyclictest0-21swapper/300:20:023
2108799230,22cyclictest17039-21ssh23:15:073
2108799230,22cyclictest14720-21diskmemload22:41:473
2108799230,22cyclictest14720-21diskmemload22:31:163
2108799230,22cyclictest0-21swapper/322:00:333
2108799230,22cyclictest0-21swapper/321:31:473
2108799230,0cyclictest0-21swapper/323:48:163
2108799230,0cyclictest0-21swapper/323:27:123
2108799230,0cyclictest0-21swapper/322:55:293
2108799230,0cyclictest0-21swapper/322:46:223
21082992323,0cyclictest0-21swapper/223:31:592
21082992323,0cyclictest0-21swapper/221:35:382
21082992323,0cyclictest0-21swapper/221:12:392
21082992322,1cyclictest26876-1kworker/u9:221:22:002
21082992322,1cyclictest0-21swapper/222:46:582
21082992321,1cyclictest0-21swapper/200:15:152
21082992320,3cyclictest0-21swapper/221:17:032
21082992320,2cyclictest30633-21sh19:30:002
2108299230,23cyclictest0-21swapper/223:28:582
2108299230,23cyclictest0-21swapper/222:16:192
2108299230,23cyclictest0-21swapper/221:34:002
2108299230,23cyclictest0-21swapper/221:29:362
2108299230,22cyclictest6747-21sh22:34:262
2108299230,22cyclictest26876-1kworker/u9:200:05:552
2108299230,22cyclictest18036-21ssh23:16:422
2108299230,22cyclictest0-21swapper/200:30:522
2108299230,1cyclictest0-21swapper/223:23:082
2108299230,0cyclictest14720-21diskmemload21:52:532
2108299230,0cyclictest0-21swapper/223:36:222
2108299230,0cyclictest0-21swapper/222:36:302
2108299230,0cyclictest0-21swapper/222:20:292
21077992323,0cyclictest14720-21diskmemload21:44:191
21077992323,0cyclictest0-21swapper/123:03:431
21077992323,0cyclictest0-21swapper/121:32:521
21077992321,1cyclictest0-21swapper/123:45:041
21077992321,1cyclictest0-21swapper/123:06:381
21077992320,2cyclictest22564-21sh23:20:331
2107799230,23cyclictest29208-21sh00:27:471
2107799230,23cyclictest0-21swapper/123:35:221
2107799230,23cyclictest0-21swapper/122:59:371
2107799230,23cyclictest0-21swapper/121:47:341
2107799230,22cyclictest14720-21diskmemload21:26:241
2107799230,22cyclictest1403-21apt-get19:36:471
2107799230,1cyclictest0-21swapper/122:00:021
2107799230,0cyclictest14720-21diskmemload00:20:211
2107799230,0cyclictest0-21swapper/121:20:111
21073992323,0cyclictest14720-21diskmemload21:11:180
21073992323,0cyclictest0-21swapper/022:37:550
21073992323,0cyclictest0-21swapper/022:33:390
21073992323,0cyclictest0-21swapper/022:22:310
21073992323,0cyclictest0-21swapper/022:11:290
21073992323,0cyclictest0-21swapper/000:00:300
21073992322,1cyclictest14720-21diskmemload23:00:560
21073992321,1cyclictest0-21swapper/023:58:040
21073992321,1cyclictest0-21swapper/023:46:510
21073992320,2cyclictest0-21swapper/000:37:090
2107399230,2cyclictest32226-21ssh22:58:350
2107399230,23cyclictest0-21swapper/023:42:160
2107399230,23cyclictest0-21swapper/023:26:420
2107399230,23cyclictest0-21swapper/000:05:220
2107399230,22cyclictest21000-21rm21:16:180
2107399230,22cyclictest14720-21diskmemload22:00:100
2107399230,22cyclictest0-21swapper/022:05:450
2107399230,22cyclictest0-21swapper/021:46:280
2107399230,0cyclictest0-21swapper/023:12:260
2107399230,0cyclictest0-21swapper/022:45:070
2107399230,0cyclictest0-21swapper/021:55:240
2107399230,0cyclictest0-21swapper/021:55:240
21087992221,1cyclictest26876-1kworker/u9:223:40:253
21087992220,1cyclictest10923-21ntp_states21:36:523
21087992220,1cyclictest0-21swapper/321:42:243
21087992220,1cyclictest0-21swapper/300:16:023
2108799220,21cyclictest25834-21apt19:20:003
2108799220,21cyclictest14745-21munin-run21:10:013
2108799220,21cyclictest14720-21diskmemload22:06:433
2108799220,21cyclictest10340-21apt-get21:01:453
2108799220,21cyclictest0-21swapper/321:22:533
2108799220,1cyclictest9992-21ssh23:38:423
2108799220,1cyclictest14308-21ssh22:11:123
2108799220,1cyclictest0-21swapper/322:15:163
21082992222,0cyclictest0-21swapper/222:00:152
21082992222,0cyclictest0-21swapper/221:46:232
21082992220,1cyclictest0-21swapper/223:00:032
21082992220,0cyclictest0-21swapper/222:56:142
21082992220,0cyclictest0-21swapper/200:10:382
2108299220,2cyclictest6276-21apt-get19:46:452
2108299220,21cyclictest28116-21dpkg20:30:022
2108299220,21cyclictest0-21swapper/223:11:452
2108299220,21cyclictest0-21swapper/219:56:452
2108299220,1cyclictest5126-21apt20:50:002
2108299220,1cyclictest25834-21ssh23:53:592
2108299220,0cyclictest13707-21apt-get22:41:472
2108299220,0cyclictest0-21swapper/222:54:032
2108299220,0cyclictest0-21swapper/221:56:532
2108299220,0cyclictest0-21swapper/221:56:532
2108299220,0cyclictest0-21swapper/200:00:472
21077992222,0cyclictest0-21swapper/122:35:341
21077992222,0cyclictest0-21swapper/100:07:561
21077992221,1cyclictest23094-21apt-get20:21:441
21077992221,1cyclictest0-21swapper/122:10:511
21077992220,1cyclictest0-21swapper/122:20:381
21077992220,1cyclictest0-21swapper/120:40:011
2107799220,22cyclictest21659-21ssh23:50:171
2107799220,22cyclictest0-21swapper/100:31:281
2107799220,21cyclictest0-21swapper/122:25:121
2107799220,21cyclictest0-21swapper/121:10:221
2107799220,21cyclictest0-21swapper/120:31:441
2107799220,21cyclictest0-21swapper/120:01:471
2107799220,1cyclictest4157-21sh00:35:501
2107799220,1cyclictest12225-21diskmemload23:41:451
2107799220,1cyclictest11997-21ssh23:10:151
2107799220,0cyclictest0-21swapper/121:15:161
21073992220,1cyclictest9952-21perf21:00:000
21073992220,1cyclictest9851-21sh23:07:170
21073992220,1cyclictest30656-21awk19:30:010
21073992220,1cyclictest27272-21awk23:25:000
21073992220,1cyclictest22179-21ssh23:51:030
21073992220,1cyclictest0-21swapper/020:31:450
2107399220,21cyclictest6276-21apt-get19:46:450
2107399220,21cyclictest19374-21ssh22:15:550
2107399220,21cyclictest18580-21ssh00:17:320
2107399220,21cyclictest0-21swapper/023:35:390
2107399220,21cyclictest0-21swapper/021:05:000
2107399220,21cyclictest0-21swapper/019:16:460
2107399220,1cyclictest151rcu_preempt22:29:310
2107399220,1cyclictest13087-21perf20:00:000
2107399220,0cyclictest0-21swapper/020:01:470
21087992121,0cyclictest14720-21diskmemload23:20:143
21087992121,0cyclictest0-21swapper/321:55:563
21087992121,0cyclictest0-21swapper/321:55:563
21087992121,0cyclictest0-21swapper/300:10:213
21087992120,1cyclictest0-21swapper/320:30:023
21087992119,1cyclictest10694-21munin-run19:55:013
2108799210,21cyclictest0-21swapper/323:51:383
2108799210,20cyclictest655-21apt-get20:41:463
2108799210,1cyclictest0-21swapper/320:51:453
21082992120,0cyclictest0-21swapper/220:26:462
2108299210,20cyclictest0-21swapper/220:16:462
2108299210,20cyclictest0-21swapper/200:35:182
21077992120,1cyclictest0-21swapper/121:01:451
2107799210,1cyclictest20256-21cron20:15:001
21073992121,0cyclictest0-21swapper/019:36:470
2107399210,20cyclictest14720-21diskmemload21:30:020
2107399210,0cyclictest0-21swapper/020:51:450
2107399210,0cyclictest0-21swapper/019:41:460
21087992020,0cyclictest0-21swapper/320:36:463
21087992020,0cyclictest0-21swapper/320:21:443
21087992020,0cyclictest0-21swapper/319:11:443
2108799200,0cyclictest0-21swapper/319:30:023
2108299200,20cyclictest0-21swapper/220:01:472
21077992020,0cyclictest25487-21apt-get20:26:451
21077992020,0cyclictest0-21swapper/120:41:461
21077992020,0cyclictest0-21swapper/119:26:441
21077992020,0cyclictest0-21swapper/119:11:441
2107799200,20cyclictest0-21swapper/120:56:471
21073992019,1cyclictest14726-21ssh21:10:010
2107399200,20cyclictest0-21swapper/019:21:450
2107399200,0cyclictest0-21swapper/020:50:000
2108799190,18cyclictest0-21swapper/319:36:473
21077991919,0cyclictest0-21swapper/120:06:481
21073991919,0cyclictest0-21swapper/020:36:460
21073991919,0cyclictest0-21swapper/020:06:480
21087991818,0cyclictest0-21swapper/320:56:473
21087991818,0cyclictest0-21swapper/320:46:443
21082991818,0cyclictest8673-21apt-get19:51:472
21082991818,0cyclictest0-21swapper/220:51:452
21082991818,0cyclictest0-21swapper/219:16:462
21082991817,1cyclictest7925-21apt-get20:56:472
21077991818,0cyclictest30634-21apt-get19:30:021
21073991817,0cyclictest20667-21apt-get20:16:460
21087991717,0cyclictest26241-21apt-get19:21:453
21087991717,0cyclictest0-21swapper/319:46:453
21087991715,1cyclictest17879-21dump-pmu-power20:10:003
21087991715,1cyclictest13071-21turbostat20:00:003
2108799170,17cyclictest0-21swapper/319:26:443
21082991717,0cyclictest0-21swapper/220:21:442
21082991717,0cyclictest0-21swapper/219:41:462
21082991717,0cyclictest0-21swapper/219:30:022
21082991716,0cyclictest21428-21apt-get19:11:442
21077991716,1cyclictest26241-21apt-get19:21:451
21077991715,1cyclictest0-21swapper/121:10:011
21073991717,0cyclictest0-21swapper/019:31:440
2108299160,15cyclictest20251-21cron20:15:002
21077991616,0cyclictest0-21swapper/120:16:461
21077991614,1cyclictest5526-21apt-get20:51:451
21073991616,0cyclictest0-21swapper/020:26:450
21073991615,1cyclictest0-21swapper/020:11:460
21087991514,1cyclictest3883-21apt-get19:41:463
21082991515,0cyclictest0-21swapper/220:41:462
21082991514,1cyclictest17859-21cron20:10:002
2108299150,14cyclictest0-21swapper/219:36:472
21077991513,1cyclictest10667-21awk19:55:011
2108799140,14cyclictest0-21swapper/320:17:253
2108799140,14cyclictest0-21swapper/320:00:253
2108799140,0cyclictest0-21swapper/320:25:013
2108799140,0cyclictest0-21swapper/320:12:053
21082991414,0cyclictest0-21swapper/221:00:182
2108299140,14cyclictest0-21swapper/221:09:272
2108299140,14cyclictest0-21swapper/220:35:122
2108299140,14cyclictest0-21swapper/219:21:002
21077991414,0cyclictest0-21swapper/120:45:111
2107799140,14cyclictest0-21swapper/119:40:141
2107799140,14cyclictest0-21swapper/119:15:201
21073991414,0cyclictest0-21swapper/020:40:240
2107399140,14cyclictest0-21swapper/019:50:290
2107399140,0cyclictest0-21swapper/019:11:390
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional