You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-17 - 01:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Wed Sep 16, 2026 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15135211488,19sleep00-21swapper/007:05:210
16137210986,18sleep30-21swapper/307:08:253
15552210290,6sleep10-21swapper/107:05:591
14465210083,11sleep20-21swapper/207:05:042
74432790,1sleep1221ktimersoftd/112:31:411
246562700,1sleep121-21rcuc/111:11:031
16290993530,3cyclictest13034-21kworker/u8:211:34:043
16289993431,2cyclictest28385-21kworker/u8:209:24:062
16289993431,2cyclictest19367-21kworker/u8:011:58:042
247402330,1sleep1221ktimersoftd/107:30:141
16290993329,2cyclictest30319-21kworker/u8:210:58:043
16290993329,2cyclictest28385-21kworker/u8:209:25:043
16289993330,2cyclictest25240-21kworker/u8:112:08:052
16289993229,2cyclictest30627-21kworker/u8:010:03:052
16289993229,2cyclictest1956-21kworker/u8:012:33:052
16290993128,2cyclictest30627-21kworker/u8:010:02:043
16290993127,2cyclictest28385-21kworker/u8:209:21:053
16289993128,2cyclictest691-21kworker/u8:109:17:042
16289993128,2cyclictest32009-21kworker/u8:210:20:042
16290993027,2cyclictest17992-21kworker/u8:210:32:053
16290993027,2cyclictest13034-21kworker/u8:211:35:053
16289993027,2cyclictest5849-21kworker/u8:110:40:042
16289993027,2cyclictest13034-21kworker/u8:211:43:052
16290992926,2cyclictest7700-21kworker/u8:212:22:053
16290992926,2cyclictest5849-21kworker/u8:110:35:053
16290992926,2cyclictest16177-21kworker/u8:111:17:043
16289992926,2cyclictest7700-21kworker/u8:212:13:042
16289992926,2cyclictest30627-21kworker/u8:010:11:052
16289992926,2cyclictest27637-21kworker/u8:112:35:042
16289992926,2cyclictest27637-21kworker/u8:112:28:042
1628999290,18cyclictest0-21swapper/212:18:052
16290992825,2cyclictest5849-21kworker/u8:110:21:053
16290992825,2cyclictest30319-21kworker/u8:210:52:043
16290992825,2cyclictest27637-21kworker/u8:112:27:053
16290992825,2cyclictest25122-21kworker/u8:109:55:053
16290992825,2cyclictest16177-21kworker/u8:111:03:053
16289992825,2cyclictest25345-21kworker/u8:011:12:042
16289992825,2cyclictest25122-21kworker/u8:109:57:042
16289992825,2cyclictest24000-21kworker/u8:011:02:052
16289992825,2cyclictest13034-21kworker/u8:211:45:042
16289992825,2cyclictest10105-21kworker/u8:009:34:042
16287992825,2cyclictest25240-21kworker/u8:111:46:040
16287992825,2cyclictest17038-21kworker/u8:012:18:040
147832280,0sleep20-21swapper/211:34:532
16290992724,2cyclictest31132-21kworker/u8:211:22:043
16290992724,2cyclictest30627-21kworker/u8:010:26:043
16290992724,2cyclictest25240-21kworker/u8:111:52:053
16290992724,2cyclictest25240-21kworker/u8:111:47:043
16290992724,2cyclictest25122-21kworker/u8:109:44:043
16290992724,2cyclictest1956-21kworker/u8:012:31:043
16290992724,2cyclictest17038-21kworker/u8:012:19:053
16289992724,2cyclictest525-21kworker/u8:208:05:052
16289992724,2cyclictest20669-21kworker/u8:107:46:052
1628999270,18cyclictest0-21swapper/210:29:052
135102270,0sleep00-21swapper/011:32:590
16290992623,2cyclictest7700-21kworker/u8:212:12:043
16290992623,2cyclictest5392-21kworker/u8:111:28:053
16290992623,2cyclictest32009-21kworker/u8:210:17:043
16290992623,2cyclictest30627-21kworker/u8:009:47:053
16290992623,2cyclictest30319-21kworker/u8:210:49:053
16290992623,2cyclictest25345-21kworker/u8:011:13:053
16290992623,2cyclictest25122-21kworker/u8:109:38:053
16290992623,2cyclictest1956-21kworker/u8:012:39:043
16290992623,2cyclictest19367-21kworker/u8:011:59:043
16290992623,2cyclictest10105-21kworker/u8:009:32:053
16289992623,2cyclictest30319-21kworker/u8:210:55:042
16289992623,2cyclictest24795-21kworker/u8:008:56:022
16289992623,2cyclictest18803-21kworker/u8:108:47:052
16289992623,2cyclictest18206-21kworker/u8:210:06:012
1628999260,18cyclictest0-21swapper/211:09:042
16287992623,2cyclictest5849-21kworker/u8:110:36:050
16287992623,2cyclictest30627-21kworker/u8:010:29:050
16287992623,2cyclictest25345-21kworker/u8:011:14:040
16287992622,3cyclictest17992-21kworker/u8:210:33:040
16290992522,2cyclictest25299-21kworker/u8:110:10:053
16290992522,2cyclictest25240-21kworker/u8:112:07:043
16287992522,2cyclictest30319-21kworker/u8:210:53:050
16287992522,2cyclictest25345-21kworker/u8:011:26:050
16287992522,2cyclictest25299-21kworker/u8:110:08:040
16287992522,2cyclictest25240-21kworker/u8:112:03:040
16287992522,2cyclictest16177-21kworker/u8:111:09:050
16290992421,2cyclictest691-21kworker/u8:109:19:043
16289992421,2cyclictest691-21kworker/u8:109:13:052
16289992421,2cyclictest28385-21kworker/u8:209:01:042
16289992421,2cyclictest20669-21kworker/u8:107:36:012
16289992421,2cyclictest10199-21kworker/u8:008:30:052
16289992421,2cyclictest10199-21kworker/u8:008:26:042
1628999240,18cyclictest0-21swapper/209:28:012
16287992421,2cyclictest30319-21kworker/u8:210:59:040
16287992421,2cyclictest30319-21kworker/u8:210:47:040
16287992421,2cyclictest25240-21kworker/u8:111:53:040
16287992421,2cyclictest25122-21kworker/u8:109:52:050
16290992320,2cyclictest16177-21kworker/u8:111:05:043
16290992319,2cyclictest691-21kworker/u8:109:11:053
16289992320,2cyclictest20669-21kworker/u8:107:50:042
16287992320,2cyclictest30627-21kworker/u8:010:24:040
16287992320,2cyclictest30627-21kworker/u8:010:13:040
16287992320,2cyclictest28385-21kworker/u8:209:28:020
16287992320,2cyclictest1956-21kworker/u8:012:38:040
16287992320,2cyclictest19367-21kworker/u8:011:40:050
16287992320,2cyclictest10105-21kworker/u8:009:33:040
1628799230,18cyclictest0-21swapper/009:24:050
16290992219,2cyclictest25310-21kworker/u8:007:24:043
16290992219,2cyclictest24795-21kworker/u8:009:06:043
16290992219,2cyclictest16226-21kworker/u8:308:34:053
16290992219,2cyclictest10199-21kworker/u8:008:28:013
16290992219,2cyclictest10199-21kworker/u8:008:16:053
16289992219,2cyclictest32068-21kworker/u8:207:12:042
16289992219,2cyclictest18803-21kworker/u8:108:36:022
16289992219,2cyclictest10199-21kworker/u8:008:20:052
1628899221,3cyclictest21581-21cut07:20:391
1628899221,19cyclictest0-21swapper/107:35:001
16287992219,2cyclictest7700-21kworker/u8:212:10:040
1628799220,11cyclictest0-21swapper/012:08:050
16290992118,2cyclictest525-21kworker/u8:208:02:013
16290992118,2cyclictest32068-21kworker/u8:207:16:023
16290992118,2cyclictest20669-21kworker/u8:107:56:053
16290992118,2cyclictest18803-21kworker/u8:108:49:053
1629099210,19cyclictest0-21swapper/308:55:123
1629099210,18cyclictest0-21swapper/311:42:043
16287992118,2cyclictest32009-21kworker/u8:210:15:050
16287992118,2cyclictest27637-21kworker/u8:112:30:050
16287992118,2cyclictest25122-21kworker/u8:109:45:040
16290992017,2cyclictest20669-21kworker/u8:107:48:043
16290992017,2cyclictest18803-21kworker/u8:108:41:043
1629099200,2cyclictest0-21swapper/310:07:043
1629099200,2cyclictest0-21swapper/308:06:053
1628999202,2cyclictest32639-21diskmemload09:48:052
1628999200,2cyclictest0-21swapper/209:50:042
1628999200,18cyclictest0-21swapper/212:02:042
1628899201,3cyclictest0-21swapper/111:00:001
1628899200,2cyclictest32639-21diskmemload09:34:251
1628899200,2cyclictest0-21swapper/109:57:351
1628899200,18cyclictest2455-21ssh09:44:351
16290991916,2cyclictest525-21kworker/u8:208:11:043
16290991916,2cyclictest24064-21kworker/u8:207:27:043
16290991916,2cyclictest20669-21kworker/u8:107:54:013
16290991916,2cyclictest10199-21kworker/u8:008:24:053
1629099190,2cyclictest0-21swapper/310:43:043
1629099190,2cyclictest0-21swapper/309:53:043
16289991916,2cyclictest525-21kworker/u8:208:12:052
16289991916,2cyclictest525-21kworker/u8:208:02:052
16289991916,2cyclictest32068-21kworker/u8:207:20:062
1628999190,2cyclictest0-21swapper/211:26:062
1628999190,2cyclictest0-21swapper/210:53:052
1628999190,2cyclictest0-21swapper/210:47:042
1628999190,2cyclictest0-21swapper/210:38:052
1628999190,18cyclictest0-21swapper/209:07:042
1628899191,3cyclictest2755-21munin-node1
1628899191,16cyclictest12990-21df_abs08:20:151
1628899190,2cyclictest0-21swapper/111:43:181
1628899190,2cyclictest0-21swapper/110:24:271
1628899190,2cyclictest0-21swapper/110:19:471
16287991916,2cyclictest24795-21kworker/u8:008:58:040
16287991916,2cyclictest20669-21kworker/u8:107:58:010
16287991916,2cyclictest18803-21kworker/u8:108:40:050
1628799190,2cyclictest0-21swapper/011:58:050
1628799190,2cyclictest0-21swapper/010:40:050
1628799190,2cyclictest0-21swapper/010:03:050
1628799190,2cyclictest0-21swapper/009:17:040
16290991815,2cyclictest20669-21kworker/u8:107:43:053
16289991815,2cyclictest20669-21kworker/u8:107:32:062
1628999180,2cyclictest0-21swapper/211:21:042
1628999180,2cyclictest0-21swapper/208:52:042
1628999180,2cyclictest0-21swapper/208:43:042
1628899188,8cyclictest0-21swapper/107:50:131
1628899181,8cyclictest0-21swapper/110:45:151
1628899181,8cyclictest0-21swapper/108:10:171
1628899181,7cyclictest3590-21tune2fs09:45:151
1628899181,3cyclictest0-21swapper/111:25:361
1628899180,2cyclictest0-21swapper/110:43:401
1628899180,2cyclictest0-21swapper/110:12:261
1628899180,2cyclictest0-21swapper/109:52:551
1628899180,2cyclictest0-21swapper/108:30:161
1628899180,1cyclictest0-21swapper/107:55:121
1628899180,16cyclictest0-21swapper/111:56:441
1628899180,16cyclictest0-21swapper/108:40:141
1628799180,2cyclictest0-21swapper/012:28:040
16290991714,2cyclictest18803-21kworker/u8:108:39:043
1628899178,2cyclictest0-21swapper/112:37:361
1628899175,3cyclictest21641-21sendmail-mta10:06:121
1628899174,3cyclictest207150irq/24-eth109:14:421
1628899173,6cyclictest2850-21rsyslogd11:05:231
1628899171,6cyclictest0-21swapper/112:14:261
1628899171,6cyclictest0-21swapper/111:35:051
1628899171,6cyclictest0-21swapper/110:33:501
1628899171,6cyclictest0-21swapper/110:25:091
1628899171,6cyclictest0-21swapper/110:03:261
1628899171,6cyclictest0-21swapper/109:39:381
1628899171,5cyclictest24802-21copy11:45:001
1628899171,3cyclictest4078-21sendmail-mta09:16:001
1628899171,3cyclictest0-21swapper/112:25:161
1628899171,3cyclictest0-21swapper/111:21:011
16288991712,4cyclictest0-21swapper/111:15:191
1628899170,7cyclictest0-21swapper/108:50:121
1628899170,6cyclictest0-21swapper/110:35:131
1628899170,16cyclictest0-21swapper/112:00:531
1628899170,16cyclictest0-21swapper/109:20:351
1628899170,16cyclictest0-21swapper/107:25:361
16287991714,2cyclictest24795-21kworker/u8:009:07:040
16287991714,2cyclictest20669-21kworker/u8:107:33:040
16287991714,2cyclictest18803-21kworker/u8:108:52:040
1628799170,2cyclictest0-21swapper/011:02:040
1628799170,2cyclictest0-21swapper/009:57:040
16290991613,2cyclictest32068-21kworker/u8:207:11:043
1629099160,2cyclictest0-21swapper/309:04:043
1628899164,3cyclictest29183-21df_abs09:00:131
1628899164,3cyclictest2849-21rs:main1
1628899164,3cyclictest27036-21cpuspeed_turbos08:55:121
1628899164,2cyclictest0-21swapper/111:00:151
1628899161,6cyclictest31226-21entropy07:45:131
1628899161,6cyclictest0-21swapper/112:15:231
1628899161,6cyclictest0-21swapper/111:52:401
1628899161,6cyclictest0-21swapper/111:31:371
1628899161,5cyclictest15704-21aten2.4-expect09:25:131
1628899161,13cyclictest22550-21apt-get08:45:051
1628899160,9cyclictest0-21swapper/109:06:321
1628899160,6cyclictest0-21swapper/112:05:301
1628899160,6cyclictest0-21swapper/108:03:111
1628899160,3cyclictest8487-21latency_hist08:09:591
16287991613,2cyclictest31132-21kworker/u8:211:21:040
16287991613,2cyclictest24064-21kworker/u8:207:28:040
16287991613,2cyclictest10199-21kworker/u8:008:18:040
16287991613,2cyclictest10199-21kworker/u8:008:13:050
1628799160,2cyclictest0-21swapper/008:27:050
1628799160,2cyclictest0-21swapper/008:05:040
16290991512,2cyclictest20669-21kworker/u8:107:32:023
16290991512,2cyclictest18803-21kworker/u8:108:50:053
1629099150,2cyclictest0-21swapper/307:35:043
1628999151,12cyclictest0-21swapper/211:35:042
1628999150,2cyclictest0-21swapper/207:16:052
1628899153,3cyclictest28850-21aten2.4-expect07:40:111
1628899151,3cyclictest20311-21munin-run07:20:001
1628899150,6cyclictest0-21swapper/108:15:171
1628899150,2cyclictest0-21swapper/107:10:191
16287991512,2cyclictest25310-21kworker/u8:007:22:050
16287991512,2cyclictest25122-21kworker/u8:109:36:050
1628799150,5cyclictest0-21swapper/007:46:050
1628799150,4cyclictest0-21swapper/008:47:050
1628799150,13cyclictest0-21swapper/007:50:040
16289991411,2cyclictest0-21swapper/212:23:292
1628899145,2cyclictest0-21swapper/108:25:171
1628799140,2cyclictest20621-21cat08:40:000
1628799140,12cyclictest0-21swapper/011:16:010
16289991310,2cyclictest0-21swapper/209:41:492
1628999130,2cyclictest32639-21diskmemload11:53:342
1628999130,2cyclictest26841-21ssh09:35:382
1628999130,12cyclictest0-21swapper/210:30:162
1628999130,12cyclictest0-21swapper/210:18:092
16287991310,2cyclictest32068-21kworker/u8:207:16:050
16287991310,2cyclictest1053-21ssh09:42:300
1628799130,2cyclictest0-21swapper/012:20:140
1628799130,2cyclictest0-21swapper/009:13:050
1628799130,2cyclictest0-21swapper/009:01:050
1628799130,2cyclictest0-21swapper/007:36:020
236702120,1sleep20-21swapper/207:26:012
163682120,2sleep00-21swapper/011:35:280
1629099122,7cyclictest0-21swapper/312:00:593
1628899120,5cyclictest0-21swapper/108:35:021
1628799129,2cyclictest20669-21kworker/u8:107:40:010
1628799120,10cyclictest0-21swapper/008:22:050
1628999118,2cyclictest0-21swapper/211:16:232
1628999110,2cyclictest0-21swapper/207:44:072
1628999110,10cyclictest0-21swapper/207:55:132
1628799110,2cyclictest0-21swapper/008:30:040
1628799110,2cyclictest0-21swapper/007:12:050
1628799107,2cyclictest0-21swapper/008:01:110
162899994,3cyclictest274-21jbd2/sda1-808:15:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional