You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-24 - 16:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Fri Jul 24, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26092992827,0cyclictest29523-21ssh11:13:242
2609699260,6cyclictest0-21swapper/309:53:193
2609699260,6cyclictest0-21swapper/309:53:193
26084992623,1cyclictest32690-21rm10:18:560
26096992522,2cyclictest32130-21cron09:50:003
2609699250,24cyclictest0-21swapper/309:44:113
26092992521,0cyclictest0-21swapper/211:28:052
26088992523,1cyclictest5569-21sh11:22:001
26088992523,1cyclictest0-21swapper/110:36:261
26088992523,1cyclictest0-21swapper/109:54:541
26088992523,1cyclictest0-21swapper/109:54:541
2608899250,24cyclictest0-21swapper/112:15:181
2608899250,24cyclictest0-21swapper/109:33:561
26084992523,1cyclictest0-21swapper/011:13:060
2608499250,24cyclictest17877-21apt-get09:37:580
2608499250,24cyclictest0-21swapper/012:32:590
26096992422,1cyclictest0-21swapper/311:35:373
26096992422,1cyclictest0-21swapper/309:13:213
2609699241,1cyclictest28643-21kworker/u8:110:18:103
2609699240,23cyclictest0-21swapper/311:56:163
26092992424,0cyclictest0-21swapper/209:52:562
26092992424,0cyclictest0-21swapper/209:52:562
26092992423,1cyclictest6548-21ssh10:53:162
26092992423,1cyclictest25908-21ssh09:44:032
2609299240,24cyclictest0-21swapper/210:24:442
2609299240,23cyclictest0-21swapper/212:04:282
26088992423,1cyclictest0-21swapper/109:55:581
26088992422,1cyclictest0-21swapper/112:32:501
26088992422,1cyclictest0-21swapper/110:25:301
2608899240,24cyclictest0-21swapper/112:26:161
2608899240,24cyclictest0-21swapper/111:41:351
2608899240,24cyclictest0-21swapper/110:17:411
2608899240,0cyclictest0-21swapper/109:42:311
26084992424,0cyclictest62550irq/127-eno110:05:190
26084992423,1cyclictest19834-21diskmemload09:15:520
2608499240,24cyclictest0-21swapper/009:56:070
2608499240,24cyclictest0-21swapper/009:14:480
2608499240,23cyclictest5579-21ssh09:26:350
2608499240,23cyclictest2995-21perl12:18:010
2608499240,0cyclictest0-21swapper/010:28:450
26096992323,0cyclictest19834-21diskmemload12:26:073
26096992323,0cyclictest19834-21diskmemload12:02:453
26096992323,0cyclictest19834-21diskmemload11:24:203
26096992323,0cyclictest0-21swapper/311:00:553
26096992323,0cyclictest0-21swapper/309:20:073
26096992321,1cyclictest0-21swapper/311:40:103
26096992321,1cyclictest0-21swapper/310:54:003
26096992320,2cyclictest313-21systemd-journal12:20:013
26096992320,2cyclictest22476-21sh12:06:173
2609699231,21cyclictest5577-21rm09:26:353
2609699231,1cyclictest25045-21apt-get12:37:593
2609699230,23cyclictest19834-21diskmemload10:27:033
2609699230,23cyclictest0-21swapper/312:10:103
2609699230,23cyclictest0-21swapper/311:15:223
2609699230,23cyclictest0-21swapper/311:07:153
2609699230,23cyclictest0-21swapper/310:39:343
2609699230,23cyclictest0-21swapper/310:21:073
2609699230,23cyclictest0-21swapper/310:08:343
2609699230,22cyclictest606-21dbus-daemon10:05:013
2609699230,22cyclictest1283-21cpuspeed_turbos11:48:013
2609699230,22cyclictest0-21swapper/311:10:123
26092992323,0cyclictest19834-21diskmemload10:25:082
26092992323,0cyclictest0-21swapper/212:31:132
26092992323,0cyclictest0-21swapper/211:05:592
26092992323,0cyclictest0-21swapper/210:01:382
26092992320,2cyclictest12241-21cron08:55:002
26092992320,0cyclictest0-21swapper/210:11:452
2609299230,2cyclictest13389-21latency_hist11:00:002
2609299230,23cyclictest0-21swapper/211:47:002
2609299230,22cyclictest28675-21ssh10:15:572
2609299230,22cyclictest16134-21ssh11:32:032
2609299230,22cyclictest0-21swapper/211:38:442
2609299230,22cyclictest0-21swapper/209:15:192
2609299230,0cyclictest0-21swapper/212:25:312
2609299230,0cyclictest0-21swapper/211:54:532
26088992323,0cyclictest19834-21diskmemload11:53:391
26088992323,0cyclictest0-21swapper/112:08:421
26088992323,0cyclictest0-21swapper/111:37:401
26088992323,0cyclictest0-21swapper/111:25:381
26088992323,0cyclictest0-21swapper/111:00:361
26088992323,0cyclictest0-21swapper/110:41:121
26088992323,0cyclictest0-21swapper/109:16:561
26088992321,1cyclictest6190-21sh10:24:201
26088992321,1cyclictest0-21swapper/110:58:381
26088992321,1cyclictest0-21swapper/110:52:001
2608899230,23cyclictest0-21swapper/112:00:421
2608899230,23cyclictest0-21swapper/111:47:461
2608899230,23cyclictest0-21swapper/111:05:011
2608899230,22cyclictest24907-21ssh12:37:511
2608899230,22cyclictest19834-21diskmemload12:12:581
2608899230,22cyclictest10831-21sh12:24:211
2608899230,22cyclictest0-21swapper/110:06:171
2608899230,0cyclictest19834-21diskmemload11:34:121
2608899230,0cyclictest19834-21diskmemload09:35:131
2608899230,0cyclictest19834-21diskmemload09:23:041
2608899230,0cyclictest0-21swapper/110:12:331
2608899230,0cyclictest0-21swapper/109:12:381
26084992323,0cyclictest19834-21diskmemload09:54:280
26084992323,0cyclictest19834-21diskmemload09:54:280
26084992323,0cyclictest0-21swapper/011:27:070
26084992323,0cyclictest0-21swapper/011:24:380
26084992323,0cyclictest0-21swapper/011:04:160
26084992323,0cyclictest0-21swapper/010:50:370
26084992323,0cyclictest0-21swapper/009:45:090
26084992322,1cyclictest0-21swapper/008:47:590
26084992321,1cyclictest0-21swapper/012:08:030
26084992321,1cyclictest0-21swapper/011:57:000
26084992321,1cyclictest0-21swapper/011:45:200
26084992320,2cyclictest30064-21diskmemload10:46:140
26084992320,2cyclictest23528-21ssh12:35:570
26084992320,2cyclictest12528-21ssh10:58:490
2608499230,23cyclictest0-21swapper/011:36:040
2608499230,23cyclictest0-21swapper/010:00:470
2608499230,22cyclictest7083-21ssh12:21:380
2608499230,22cyclictest19834-21diskmemload09:31:110
2608499230,22cyclictest14651-21cron09:00:000
2608499230,22cyclictest0-21swapper/012:12:370
2608499230,22cyclictest0-21swapper/010:42:590
2608499230,1cyclictest20874-21basename10:38:000
2608499230,1cyclictest13015-21munin-run07:50:000
2608499230,1cyclictest0-21swapper/009:23:190
2608499230,0cyclictest0-21swapper/009:02:580
26096992222,0cyclictest0-21swapper/309:55:503
26096992221,1cyclictest0-21swapper/311:30:393
26096992220,1cyclictest17036-21cron09:05:003
2609699221,1cyclictest17867-21rm12:30:553
2609699220,21cyclictest606-21dbus-daemon07:50:003
2609699220,21cyclictest4980-21sh08:40:003
2609699220,21cyclictest29578-21rm10:45:283
2609699220,21cyclictest25747-21apt-get10:42:593
2609699220,21cyclictest19834-21diskmemload09:35:443
2609699220,21cyclictest19834-21diskmemload09:31:063
2609699220,21cyclictest0-21swapper/311:51:583
2609699220,21cyclictest0-21swapper/311:25:423
2609699220,21cyclictest0-21swapper/310:55:553
2609699220,21cyclictest0-21swapper/310:30:073
2609699220,1cyclictest331rcuc/310:10:153
2609699220,1cyclictest25761-21ssh09:15:073
26092992222,0cyclictest0-21swapper/212:12:232
26092992222,0cyclictest0-21swapper/210:46:102
26092992221,1cyclictest9956-21ssh12:23:122
26092992221,1cyclictest19834-21diskmemload12:38:232
26092992221,1cyclictest11580-21rm11:56:462
26092992220,2cyclictest0-21swapper/209:26:102
26092992220,1cyclictest5025-21munin-run08:40:002
2609299221,21cyclictest22155-21ssh12:05:532
2609299220,2cyclictest312-21sh12:15:072
2609299220,22cyclictest0-21swapper/209:31:082
2609299220,21cyclictest5697-21ssh09:55:052
2609299220,21cyclictest4300-21ssh11:20:192
2609299220,21cyclictest31316-21ssh09:20:032
2609299220,21cyclictest28083-21ssh09:46:482
2609299220,21cyclictest0-21swapper/210:06:412
2609299220,21cyclictest0-21swapper/208:02:592
2609299220,1cyclictest16342-21ssh09:35:542
2609299220,1cyclictest13517-21ssh10:31:182
2609299220,0cyclictest19834-21diskmemload11:40:532
2609299220,0cyclictest0-21swapper/211:15:412
26088992222,0cyclictest0-21swapper/111:15:581
26088992222,0cyclictest0-21swapper/109:25:061
26088992221,0cyclictest0-21swapper/109:02:581
26088992220,1cyclictest0-21swapper/110:46:401
2608899220,2cyclictest27231-21ssh09:45:331
2608899220,21cyclictest26552-21sh11:11:431
2608899220,21cyclictest11557-21sh10:00:281
2608899220,21cyclictest0-21swapper/111:58:081
2608899220,21cyclictest0-21swapper/107:53:001
2608899220,1cyclictest13140-21diskmemload10:30:501
26084992222,0cyclictest19834-21diskmemload09:41:090
26084992222,0cyclictest0-21swapper/012:00:330
2608499220,22cyclictest0-21swapper/010:22:480
2608499220,21cyclictest31443-21ssh11:15:480
2608499220,21cyclictest19834-21diskmemload12:25:320
2608499220,21cyclictest19834-21diskmemload11:40:280
2608499220,21cyclictest19834-21diskmemload10:10:030
2608499220,21cyclictest0-21swapper/011:06:230
2608499220,21cyclictest0-21swapper/008:52:590
2608499220,1cyclictest26534-21apt-get07:12:590
2608499220,1cyclictest17794-21wc08:00:000
2608499220,1cyclictest0-21swapper/011:30:080
2608499220,0cyclictest0-21swapper/011:50:310
2608499220,0cyclictest0-21swapper/010:30:380
26096992121,0cyclictest0-21swapper/307:38:003
26096992119,1cyclictest29808-21latency_hist08:25:013
26096992119,1cyclictest25486-21apt-get08:17:593
26096992119,1cyclictest0-21swapper/307:55:003
26096992119,1cyclictest0-21swapper/307:25:003
2609699210,21cyclictest0-21swapper/308:27:593
2609699210,20cyclictest0-21swapper/308:42:593
2609699210,20cyclictest0-21swapper/307:42:593
2609699210,1cyclictest0-21swapper/308:47:583
26092992121,0cyclictest5504-21apt-get08:42:592
26092992120,1cyclictest0-21swapper/207:53:002
26092992119,1cyclictest22581-21cron08:10:002
2609299210,21cyclictest19834-21diskmemload11:00:322
2609299210,21cyclictest13003-21basename07:50:002
2609299210,20cyclictest28934-21apt-get07:18:002
2609299210,1cyclictest24721-21ssh10:41:302
2609299210,0cyclictest0-21swapper/209:10:262
26088992119,1cyclictest23091-21apt-get08:13:001
26088992119,1cyclictest12264-21perf08:55:001
2608899210,20cyclictest0-21swapper/108:17:591
2608899210,20cyclictest0-21swapper/107:38:001
2608899210,20cyclictest0-21swapper/107:32:581
2608499210,20cyclictest0-21swapper/008:35:010
2608499210,0cyclictest0-21swapper/007:18:000
2609699200,0cyclictest0-21swapper/307:12:593
26092992020,0cyclictest661-21apt-get08:32:582
26092992020,0cyclictest0-21swapper/207:12:592
26092992019,1cyclictest8650-21apt-get07:42:592
2609299200,0cyclictest0-21swapper/209:02:582
2609299200,0cyclictest0-21swapper/207:27:592
2609299200,0cyclictest0-21swapper/207:27:592
26088992020,0cyclictest0-21swapper/109:05:021
26088992020,0cyclictest0-21swapper/108:27:591
26088992020,0cyclictest0-21swapper/108:02:581
26088992020,0cyclictest0-21swapper/107:27:591
26088992020,0cyclictest0-21swapper/107:27:591
26084992020,0cyclictest6130-21apt-get07:38:000
26084992020,0cyclictest0-21swapper/008:13:000
26084992020,0cyclictest0-21swapper/007:42:590
26084992018,1cyclictest18303-21apt-get08:02:590
2608499200,0cyclictest0-21swapper/007:22:590
26096991919,0cyclictest0-21swapper/307:18:003
26092991919,0cyclictest0-21swapper/208:58:002
26092991918,1cyclictest30703-21apt-get08:27:592
2609299190,1cyclictest6130-21apt-get07:38:002
26088991919,0cyclictest0-21swapper/107:47:581
26088991919,0cyclictest0-21swapper/107:18:001
26084991917,1cyclictest0-21swapper/008:17:590
26096991818,0cyclictest0-21swapper/309:07:583
26096991816,1cyclictest0-21swapper/308:15:003
26092991818,0cyclictest0-21swapper/207:32:582
26088991818,0cyclictest0-21swapper/107:58:011
26088991816,1cyclictest7896-21apt-get08:47:581
26084991818,0cyclictest0-21swapper/008:22:580
26084991816,1cyclictest0-21swapper/007:32:580
26096991717,0cyclictest0-21swapper/308:02:593
26092991717,0cyclictest0-21swapper/208:17:592
26088991716,1cyclictest0-21swapper/107:42:591
26084991717,0cyclictest0-21swapper/007:53:000
26084991716,1cyclictest0-21swapper/009:07:580
26084991715,1cyclictest0-21swapper/008:30:010
26096991616,0cyclictest0-21swapper/308:58:003
26096991616,0cyclictest0-21swapper/307:32:583
26096991616,0cyclictest0-21swapper/307:30:013
26096991616,0cyclictest0-21swapper/307:30:013
26092991616,0cyclictest0-21swapper/209:05:022
2608899160,15cyclictest29829-21perf08:25:011
26084991616,0cyclictest0-21swapper/008:07:580
26084991614,1cyclictest611-21irqbalance08:37:260
26096991515,0cyclictest0-21swapper/308:32:583
26092991515,0cyclictest15889-21apt-get07:58:012
2609299150,15cyclictest839-21perf07:25:012
26088991515,0cyclictest0-21swapper/108:42:581
2608899150,0cyclictest0-21swapper/108:58:001
26096991414,0cyclictest0-21swapper/308:50:093
2609699140,14cyclictest0-21swapper/307:55:383
2609699140,0cyclictest0-21swapper/308:05:043
2609299140,14cyclictest0-21swapper/208:46:402
2609299140,14cyclictest0-21swapper/208:20:112
2609299140,14cyclictest0-21swapper/208:10:332
26088991414,0cyclictest0-21swapper/108:30:081
26088991414,0cyclictest0-21swapper/108:05:321
26088991414,0cyclictest0-21swapper/107:10:431
2608899140,14cyclictest0-21swapper/108:35:071
2608899140,14cyclictest0-21swapper/107:20:371
2608499140,14cyclictest0-21swapper/007:25:230
2608499140,14cyclictest0-21swapper/007:25:230
2608499140,0cyclictest0-21swapper/008:40:330
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional