You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-09 - 01:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Tue Jun 09, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
23090210998,6sleep10-21swapper/119:08:361
23124210796,6sleep00-21swapper/019:09:030
22946210695,6sleep30-21swapper/319:06:463
23106210190,6sleep20-21swapper/219:08:492
210942760,1sleep0101ktimersoftd/021:59:230
116022750,0sleep30-21swapper/300:06:173
239442730,0sleep10-21swapper/123:10:311
132222690,1sleep229-21rcuc/200:09:052
321682600,1sleep10-21swapper/100:30:001
23226994317,24cyclictest0-21swapper/021:00:110
7192330,0sleep30-21swapper/322:46:013
97392290,1sleep20-21swapper/221:11:482
2322799250,23cyclictest0-21swapper/122:10:111
325232240,1sleep00-21swapper/021:36:030
274482220,1sleep127444-21ssh23:49:591
2322999200,18cyclictest0-21swapper/322:10:113
23228992017,2cyclictest0-21swapper/221:25:102
23228992016,2cyclictest0-21swapper/220:25:102
2322799200,2cyclictest0-21swapper/119:30:121
23226992017,2cyclictest0-21swapper/021:25:100
23226992015,3cyclictest12883-21ssh22:25:100
23226991916,2cyclictest0-21swapper/022:20:120
2322799181,15cyclictest0-21swapper/123:30:101
79632170,1sleep30-21swapper/322:54:233
2322999170,3cyclictest23330-21munin-node3
184122170,0sleep20-21swapper/222:30:162
23229991611,3cyclictest17462-21date22:30:003
23228991612,3cyclictest31617-21kworker/u8:120:56:022
23226991611,3cyclictest0-21swapper/023:05:470
2322699160,14cyclictest0-21swapper/022:50:150
2322999150,13cyclictest0-21swapper/321:48:033
2322999150,13cyclictest0-21swapper/321:11:533
23228991510,3cyclictest19147-21latency_hist20:19:592
2322799152,7cyclictest0-21swapper/119:45:001
2322799151,2cyclictest8568-21ssh22:20:141
2322799151,12cyclictest8702-21sh00:39:231
2322799150,4cyclictest20443-21sh21:58:191
2322799150,3cyclictest6355-21ssh22:17:311
2322799150,3cyclictest26728-21cat22:40:011
2322799150,13cyclictest0-21swapper/123:18:051
2322799150,13cyclictest0-21swapper/100:31:221
2322699152,7cyclictest0-21swapper/000:14:590
23226991510,3cyclictest27279-21sed19:19:590
2322699150,13cyclictest4918-21aten2.4_r3power00:35:120
2322999149,3cyclictest16626-21sh23:37:343
2322999149,3cyclictest0-21swapper/323:56:003
2322999142,6cyclictest0-21swapper/319:39:593
23229991411,2cyclictest0-21swapper/323:26:033
23229991411,2cyclictest0-21swapper/322:40:423
23229991411,2cyclictest0-21swapper/321:52:423
23229991411,2cyclictest0-21swapper/300:22:423
23229991411,2cyclictest0-21swapper/300:01:333
2322999141,11cyclictest0-21swapper/322:26:033
2322999141,11cyclictest0-21swapper/320:20:063
2322999140,3cyclictest21966-21fschecks_time21:25:133
2322999140,2cyclictest0-21swapper/322:20:143
2322999140,12cyclictest0-21swapper/321:40:113
2322899149,3cyclictest29292-21ssh21:33:072
2322899149,3cyclictest21313-21ssh23:42:312
23228991411,2cyclictest29651-21kworker/u8:119:30:052
23228991411,2cyclictest12877-21apt-get22:25:102
23228991411,2cyclictest0-21swapper/223:30:092
2322799149,3cyclictest207150irq/24-eth100:00:111
2322799149,3cyclictest0-21swapper/121:46:231
2322799141,11cyclictest0-21swapper/122:05:091
23227991410,2cyclictest1764-21ssh22:47:091
2322799140,2cyclictest0-21swapper/121:36:241
2322799140,12cyclictest22037-21sh00:18:271
2322799140,12cyclictest13369-21apt-get23:00:111
2322799140,12cyclictest0-21swapper/123:23:201
2322799140,12cyclictest0-21swapper/123:06:041
2322699149,3cyclictest26798-21ssh23:14:350
2322699149,3cyclictest22198-21df_abs22:00:140
2322699140,2cyclictest0-21swapper/020:20:100
2322699140,12cyclictest773-21ssh23:20:270
2322699140,12cyclictest7068-21diskmemload22:08:570
2322699140,12cyclictest29430-21ssh22:41:590
2322699140,12cyclictest26815-21sh21:30:160
2322699140,12cyclictest17255-21ssh23:04:150
2322699140,12cyclictest0-21swapper/022:37:360
2322699140,12cyclictest0-21swapper/022:19:480
2322699140,12cyclictest0-21swapper/020:25:400
2322699140,12cyclictest0-21swapper/000:05:100
8202130,2sleep20-21swapper/221:36:582
42442130,2sleep20-21swapper/200:34:432
2322999138,3cyclictest0-21swapper/322:00:163
2322999131,2cyclictest13735-21diskstats20:05:173
23229991310,2cyclictest0-21swapper/323:43:533
23229991310,2cyclictest0-21swapper/323:17:343
23229991310,2cyclictest0-21swapper/323:06:123
23229991310,2cyclictest0-21swapper/321:32:143
23229991310,2cyclictest0-21swapper/319:40:123
2322999130,12cyclictest0-21swapper/322:05:103
2322999130,11cyclictest0-21swapper/323:00:113
2322999130,11cyclictest0-21swapper/322:15:033
2322899139,3cyclictest7068-21diskmemload21:15:102
2322899138,3cyclictest9325-21cut00:05:002
2322899138,3cyclictest29-21rcuc/223:30:002
2322899131,10cyclictest15835-21ssh23:36:182
23228991310,2cyclictest16495-21kworker/u8:023:18:062
23228991310,2cyclictest0-21swapper/221:05:072
2322899130,2cyclictest0-21swapper/223:56:032
2322899130,12cyclictest0-21swapper/223:10:152
2322899130,11cyclictest25909-21sh22:38:552
2322799132,9cyclictest4750-21cpuspeed_turbos23:25:131
2322799132,7cyclictest0-21swapper/122:59:591
2322799132,6cyclictest0-21swapper/121:00:011
2322799132,6cyclictest0-21swapper/120:49:591
2322799131,9cyclictest27760-21grep20:40:131
2322799131,11cyclictest63150irq/16-ehci_hcd20:05:531
2322799131,10cyclictest0-21swapper/121:20:161
23227991310,2cyclictest0-21swapper/122:31:331
23227991310,2cyclictest0-21swapper/122:29:431
23227991310,2cyclictest0-21swapper/121:51:121
23227991310,2cyclictest0-21swapper/121:30:581
23227991310,2cyclictest0-21swapper/121:26:181
23227991310,2cyclictest0-21swapper/121:11:021
23227991310,2cyclictest0-21swapper/120:56:041
23227991310,2cyclictest0-21swapper/100:13:451
2322799130,1cyclictest207150irq/24-eth123:35:141
2322799130,12cyclictest0-21swapper/122:42:521
2322799130,12cyclictest0-21swapper/121:40:311
2322699132,7cyclictest0-21swapper/021:05:000
2322699132,6cyclictest0-21swapper/019:54:590
23226991310,2cyclictest0-21swapper/023:55:090
23226991310,2cyclictest0-21swapper/023:30:590
23226991310,2cyclictest0-21swapper/022:30:150
23226991310,2cyclictest0-21swapper/021:47:560
2322699130,2cyclictest0-21swapper/022:14:470
2322699130,2cyclictest0-21swapper/021:17:590
2322699130,12cyclictest0-21swapper/021:43:100
2322699130,12cyclictest0-21swapper/020:06:050
2322699130,12cyclictest0-21swapper/000:20:180
2322699130,11cyclictest9405-21ssh21:11:160
2322699130,11cyclictest7068-21diskmemload22:56:180
2322699130,11cyclictest7068-21diskmemload00:26:370
2322699130,11cyclictest0-21swapper/023:51:090
2322699130,11cyclictest0-21swapper/023:41:270
2322699130,11cyclictest0-21swapper/000:15:390
82072120,2sleep20-21swapper/222:54:472
303802120,2sleep230390-21ssh22:43:322
2322999127,3cyclictest32171-21munin-run00:30:003
2322999122,5cyclictest0-21swapper/320:15:003
2322999122,5cyclictest0-21swapper/320:04:593
2322999120,11cyclictest0-21swapper/323:53:243
2322999120,11cyclictest0-21swapper/323:30:113
2322999120,11cyclictest0-21swapper/319:20:123
2322999120,11cyclictest0-21swapper/300:11:543
2322899129,2cyclictest863-21kworker/u8:222:48:022
2322899129,2cyclictest7068-21diskmemload21:20:482
2322899129,2cyclictest27658-21kworker/u8:323:53:052
2322899129,2cyclictest0-21swapper/223:20:132
2322899129,2cyclictest0-21swapper/220:45:202
2322899129,2cyclictest0-21swapper/219:20:162
2322899127,3cyclictest7068-21diskmemload00:26:032
2322899122,6cyclictest0-21swapper/223:46:002
2322899121,2cyclictest7068-21diskmemload00:14:282
2322899120,2cyclictest0-21swapper/222:16:562
2322899120,2cyclictest0-21swapper/222:14:142
2322899120,2cyclictest0-21swapper/221:46:202
2322899120,2cyclictest0-21swapper/220:40:132
2322899120,11cyclictest0-21swapper/221:00:122
2322899120,11cyclictest0-21swapper/220:30:132
2322899120,11cyclictest0-21swapper/200:20:532
2322799129,2cyclictest0-21swapper/123:56:311
2322799129,2cyclictest0-21swapper/123:40:181
2322799129,2cyclictest0-21swapper/121:15:071
2322799129,2cyclictest0-21swapper/119:15:141
2322799128,2cyclictest0-21swapper/123:50:141
2322799128,2cyclictest0-21swapper/119:40:131
2322799122,7cyclictest0-21swapper/120:14:591
2322799121,9cyclictest1077-21apt-get19:35:121
2322799121,9cyclictest0-21swapper/121:05:161
2322799121,9cyclictest0-21swapper/120:16:001
2322799121,9cyclictest0-21swapper/100:20:111
2322799121,6cyclictest7068-21diskmemload22:00:011
2322799121,6cyclictest0-21swapper/120:29:591
2322799121,3cyclictest0-21swapper/120:35:131
2322799120,2cyclictest0-21swapper/119:55:181
2322799120,11cyclictest0-21swapper/122:52:111
2322699129,2cyclictest0-21swapper/023:27:260
2322699129,2cyclictest0-21swapper/022:45:140
2322699129,2cyclictest0-21swapper/019:22:160
2322699129,2cyclictest0-21swapper/000:01:540
2322699128,2cyclictest5927-21ethtool19:45:170
2322699123,6cyclictest32165-21iostat_ios20:50:160
2322699120,2cyclictest0-21swapper/023:35:180
2322699120,2cyclictest0-21swapper/023:16:370
2322699120,2cyclictest0-21swapper/021:21:300
2322699120,2cyclictest0-21swapper/019:59:160
2322699120,2cyclictest0-21swapper/000:30:400
2322699120,11cyclictest0-21swapper/023:45:260
2322699120,11cyclictest0-21swapper/021:50:270
182312120,2sleep30-21swapper/321:21:003
111472120,2sleep10-21swapper/100:06:041
103632120,2sleep20-21swapper/222:21:242
307432110,0sleep20-21swapper/219:26:022
2322999118,2cyclictest0-21swapper/320:16:033
2322999116,3cyclictest9074-21cron00:40:003
2322999111,6cyclictest3728-21runrttasks20:51:003
2322999111,6cyclictest0-21swapper/321:10:003
2322999110,9cyclictest0-21swapper/321:35:073
2322999110,3cyclictest0-21swapper/321:16:053
2322999110,2cyclictest0-21swapper/319:15:153
2322999110,10cyclictest0-21swapper/322:55:433
2322899118,2cyclictest7068-21diskmemload22:05:222
2322899118,2cyclictest16243-21kworker/u8:022:00:022
2322899118,2cyclictest13502-21kworker/u8:120:38:052
2322899118,2cyclictest0-21swapper/221:42:552
2322899118,2cyclictest0-21swapper/200:17:462
2322899113,6cyclictest0-21swapper/200:36:002
2322899111,6cyclictest0-21swapper/219:36:012
2322899111,5cyclictest0-21swapper/219:15:002
2322899110,6cyclictest0-21swapper/221:55:052
2322899110,2cyclictest0-21swapper/223:08:562
2322899110,2cyclictest0-21swapper/223:00:382
2322899110,10cyclictest0-21swapper/221:51:382
2322799116,3cyclictest0-21swapper/120:30:131
2322799116,3cyclictest0-21swapper/120:00:141
2322799111,8cyclictest27475-21munin-node1
2322799111,8cyclictest0-21swapper/120:45:171
2322799111,8cyclictest0-21swapper/119:25:181
2322799111,2cyclictest19149-21apt-get20:20:051
2322799110,3cyclictest0-21swapper/119:50:121
2322699116,3cyclictest29577-21telnet20:45:130
2322699111,6cyclictest0-21swapper/020:40:130
2322699111,6cyclictest0-21swapper/020:10:080
2322699111,5cyclictest0-21swapper/021:00:000
2322699111,3cyclictest0-21swapper/019:30:140
2322699110,10cyclictest0-21swapper/020:16:040
2322999107,2cyclictest14853-1kworker/u9:121:57:253
2322999107,2cyclictest0-21swapper/323:11:073
2322999107,2cyclictest0-21swapper/300:15:133
2322999105,3cyclictest28575-21mailstats20:41:013
2322999105,2cyclictest23564-21telnet20:30:123
2322999104,4cyclictest26011-21tr20:35:143
2322999101,5cyclictest0-21swapper/319:45:123
2322999100,8cyclictest7068-21diskmemload23:20:023
2322999100,8cyclictest2518-21ssh00:31:573
2322899107,2cyclictest29651-21kworker/u8:119:53:042
2322899107,2cyclictest10957-21kworker/u8:019:59:052
2322899105,3cyclictest31552-21telnet20:50:112
2322899105,3cyclictest13728-21sed20:05:162
2322899101,7cyclictest11855-21cut20:00:132
2322899101,5cyclictest0-21swapper/219:15:012
2322899100,9cyclictest0-21swapper/222:59:192
2322699105,3cyclictest24747-21grep19:11:030
2322699105,3cyclictest24005-21gltestperf20:30:130
2322699105,3cyclictest13111-21cron20:05:000
2322699105,3cyclictest0-21swapper/019:43:130
2322699102,6cyclictest0-21swapper/020:40:000
2322699102,5cyclictest0-21swapper/019:24:590
162122100,2sleep20-21swapper/220:10:192
232299995,3cyclictest1-21init20:56:163
232299994,3cyclictest9300-21munin-node3
232299994,3cyclictest30548-21pzem_voltage19:25:513
232299994,3cyclictest0-21swapper/321:00:113
232299992,6cyclictest0-21swapper/319:11:013
232299991,6cyclictest0-21swapper/320:25:123
232299991,6cyclictest0-21swapper/319:31:393
232299990,7cyclictest0-21swapper/319:50:123
232299990,5cyclictest0-21swapper/322:36:003
232289996,2cyclictest16897-21kworker/u8:220:21:052
232279990,2cyclictest0-21swapper/119:10:121
232269990,2cyclictest0-21swapper/019:35:140
3123280,2sleep20-21swapper/219:40:102
232299983,3cyclictest29577-21telnet20:45:133
232289983,3cyclictest5813-21fschecks_time19:45:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional