You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-14 - 18:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Mon Sep 14, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
302422115104,6sleep00-21swapper/007:05:220
30962211099,6sleep10-21swapper/107:09:151
31011210897,6sleep30-21swapper/307:09:523
30754210785,16sleep20-21swapper/207:06:352
1658921070,0sleep10-21swapper/109:43:241
18792870,0sleep00-21swapper/012:10:500
136212840,1sleep30-21swapper/309:40:143
8632790,0sleep10-21swapper/111:05:131
322582790,0sleep00-21swapper/009:59:350
53482560,1sleep00-21swapper/009:31:290
31054993517,2cyclictest0-21swapper/209:50:102
31055993430,2cyclictest4631-21kworker/u8:309:34:023
31055993330,2cyclictest31229-21kworker/u8:010:03:043
31055993330,2cyclictest17203-21kworker/u8:012:01:043
31054993330,2cyclictest7380-21kworker/u8:009:17:042
31054993330,2cyclictest25963-21kworker/u8:110:18:062
31054993330,2cyclictest25963-21kworker/u8:110:18:052
31054993330,2cyclictest15429-21kworker/u8:310:31:042
31054993329,2cyclictest17203-21kworker/u8:012:02:042
31055993229,2cyclictest30280-21kworker/u8:212:07:053
31055993229,2cyclictest25580-21kworker/u8:011:03:043
31055993227,3cyclictest17203-21kworker/u8:011:55:043
31054993229,2cyclictest27941-21kworker/u8:112:21:042
31055993127,2cyclictest17533-21kworker/u8:211:29:043
31054993128,2cyclictest32030-21kworker/u8:111:08:052
31054993128,2cyclictest27603-21kworker/u8:110:49:042
31054993128,2cyclictest19633-21kworker/u8:210:54:042
31054993128,2cyclictest17775-21kworker/u8:209:29:042
31054993128,2cyclictest13191-21kworker/u8:009:46:052
31054993128,2cyclictest11500-21kworker/u8:211:53:042
31055993027,2cyclictest27941-21kworker/u8:112:20:043
31055993027,2cyclictest27603-21kworker/u8:110:48:043
31055993027,2cyclictest27603-21kworker/u8:110:37:043
31055993027,2cyclictest25963-21kworker/u8:109:59:053
31055993027,2cyclictest25963-21kworker/u8:109:53:043
31054993027,2cyclictest27941-21kworker/u8:111:41:042
31054993027,2cyclictest25963-21kworker/u8:109:58:042
31055992926,2cyclictest7380-21kworker/u8:009:16:013
31055992926,2cyclictest31229-21kworker/u8:010:07:043
31055992926,2cyclictest27941-21kworker/u8:112:18:013
31055992926,2cyclictest17533-21kworker/u8:211:22:053
31054992926,2cyclictest4631-21kworker/u8:309:38:042
31054992926,2cyclictest17552-21kworker/u8:012:29:042
31054992926,2cyclictest15429-21kworker/u8:310:21:042
31054992926,2cyclictest13191-21kworker/u8:009:43:042
3105299290,19cyclictest0-21swapper/007:20:110
31055992825,2cyclictest4631-21kworker/u8:309:36:043
31055992825,2cyclictest30280-21kworker/u8:212:32:053
31055992825,2cyclictest27603-21kworker/u8:110:56:043
31055992825,2cyclictest19633-21kworker/u8:210:51:043
31055992825,2cyclictest1898-21kworker/u8:011:46:053
31054992825,2cyclictest8150-21kworker/u8:010:41:052
31054992825,2cyclictest4631-21kworker/u8:309:33:042
31054992825,2cyclictest31229-21kworker/u8:010:13:052
31054992825,2cyclictest31229-21kworker/u8:010:01:042
31054992825,2cyclictest30280-21kworker/u8:212:35:042
31054992825,2cyclictest25580-21kworker/u8:010:59:042
31054992825,2cyclictest1898-21kworker/u8:011:48:012
31054992825,2cyclictest17775-21kworker/u8:209:22:042
31055992724,2cyclictest7380-21kworker/u8:009:10:053
31055992724,2cyclictest5618-21kworker/u8:011:12:043
31055992724,2cyclictest32030-21kworker/u8:111:17:043
31055992724,2cyclictest32030-21kworker/u8:111:07:043
31055992724,2cyclictest27603-21kworker/u8:110:33:043
31055992724,2cyclictest15429-21kworker/u8:310:20:043
31054992724,2cyclictest6719-21kworker/u8:208:05:052
31054992724,2cyclictest5618-21kworker/u8:011:13:042
31054992724,2cyclictest30280-21kworker/u8:212:33:042
3105499270,18cyclictest0-21swapper/210:27:042
31055992623,2cyclictest8150-21kworker/u8:010:44:043
31055992623,2cyclictest6719-21kworker/u8:208:21:043
31055992623,2cyclictest31229-21kworker/u8:010:12:043
31055992623,2cyclictest30280-21kworker/u8:212:10:043
31055992623,2cyclictest27941-21kworker/u8:111:52:043
31055992623,2cyclictest27941-21kworker/u8:111:34:013
31055992623,2cyclictest25963-21kworker/u8:110:16:053
31055992623,2cyclictest25963-21kworker/u8:110:16:043
31055992623,2cyclictest1898-21kworker/u8:011:40:043
31055992623,2cyclictest17775-21kworker/u8:209:49:043
31055992623,2cyclictest17552-21kworker/u8:012:28:043
31054992623,2cyclictest912-21kworker/u8:207:17:052
31054992623,2cyclictest4648-21kworker/u8:007:37:042
31054992623,2cyclictest25469-21kworker/u8:008:37:042
31054992623,2cyclictest17203-21kworker/u8:011:57:042
3105499260,18cyclictest0-21swapper/212:14:042
31055992522,2cyclictest31613-21kworker/u8:208:55:043
31055992522,2cyclictest16886-21kworker/u8:108:09:043
31055992522,2cyclictest15429-21kworker/u8:310:26:043
31054992522,2cyclictest7380-21kworker/u8:008:51:042
31055992421,2cyclictest30881-21kworker/u8:007:14:043
31055992421,2cyclictest29772-21kworker/u8:009:26:013
31055992421,2cyclictest2785-21kworker/u8:108:41:053
31054992421,2cyclictest7380-21kworker/u8:009:06:042
31054992421,2cyclictest6719-21kworker/u8:207:58:042
31054992421,2cyclictest31613-21kworker/u8:208:58:042
31054992421,2cyclictest29041-21kworker/u8:108:28:012
31054992421,2cyclictest16886-21kworker/u8:108:15:042
31054992421,2cyclictest16886-21kworker/u8:108:12:012
3105399241,3cyclictest13776-21grep09:05:151
31055992320,2cyclictest4648-21kworker/u8:007:40:043
31055992320,2cyclictest31613-21kworker/u8:208:54:043
31055992320,2cyclictest31613-21kworker/u8:208:47:043
31055992320,2cyclictest29041-21kworker/u8:108:30:043
31054992320,2cyclictest6719-21kworker/u8:208:02:042
31054992320,2cyclictest32030-21kworker/u8:111:16:042
31054992320,2cyclictest31613-21kworker/u8:208:49:042
31054992320,2cyclictest31613-21kworker/u8:208:31:052
31054992320,2cyclictest28254-21kworker/u8:107:26:042
31054992320,2cyclictest2785-21kworker/u8:108:42:042
3105499230,18cyclictest0-21swapper/209:10:012
3105399231,3cyclictest0-21swapper/111:53:421
31055992219,2cyclictest6719-21kworker/u8:207:57:043
31055992219,2cyclictest29041-21kworker/u8:108:26:043
31055992219,2cyclictest27941-21kworker/u8:111:35:043
31055992219,2cyclictest13315-21kworker/u8:109:05:053
3105599220,18cyclictest0-21swapper/312:37:043
31054992219,2cyclictest4648-21kworker/u8:007:32:012
31054992219,2cyclictest30881-21kworker/u8:007:10:042
31054992219,2cyclictest28254-21kworker/u8:107:22:042
31053992217,3cyclictest405-21ssh12:10:101
3105399220,3cyclictest16142-21hddtemp_smartct11:20:141
3105299221,2cyclictest0-21swapper/009:00:120
31055992118,2cyclictest912-21kworker/u8:207:16:053
31055992118,2cyclictest4648-21kworker/u8:007:35:043
31054992118,2cyclictest7380-21kworker/u8:009:00:042
3105399211,3cyclictest4005-21sendmail-mta12:16:241
3105399210,3cyclictest4006-21sendmail-mta10:04:141
3105399210,3cyclictest21911-21grep08:05:151
3105399210,3cyclictest0-21swapper/112:04:191
3105399210,3cyclictest0-21swapper/110:10:151
3105399210,3cyclictest0-21swapper/109:16:021
3105399210,3cyclictest0-21swapper/108:30:151
3105399210,2cyclictest1264-21fschecks_count07:15:141
31055992017,2cyclictest6719-21kworker/u8:207:46:043
31055992017,2cyclictest28254-21kworker/u8:107:21:043
31054992017,2cyclictest6719-21kworker/u8:207:54:042
3105499200,2cyclictest0-21swapper/211:26:042
3105499200,2cyclictest0-21swapper/211:01:042
3105399201,3cyclictest0-21swapper/111:00:121
3105399200,3cyclictest69032sleep111:10:381
3105399200,3cyclictest29120-21ssh09:55:301
3105399200,3cyclictest26461-21sed12:35:191
3105399200,3cyclictest26138-21ssh09:52:501
3105399200,3cyclictest2511-21sshd11:39:551
3105399200,3cyclictest21511-21ssh12:30:191
3105399200,3cyclictest20085-21sh11:56:161
3105399200,3cyclictest19801-21sh08:00:141
3105399200,3cyclictest11658-21grep07:40:141
3105399200,3cyclictest0-21swapper/112:26:031
3105399200,3cyclictest0-21swapper/112:23:121
3105399200,3cyclictest0-21swapper/112:05:031
3105399200,3cyclictest0-21swapper/110:46:541
3105399200,3cyclictest0-21swapper/110:24:141
3105399200,3cyclictest0-21swapper/109:48:431
3105399200,3cyclictest0-21swapper/109:25:301
3105399200,2cyclictest0-21swapper/109:13:581
3105399200,18cyclictest32383-21mailstats07:11:001
3105399200,18cyclictest0-21swapper/110:05:121
31055991916,2cyclictest6719-21kworker/u8:208:01:043
31055991916,2cyclictest31613-21kworker/u8:208:35:043
3105599190,2cyclictest0-21swapper/309:20:043
3105599190,2cyclictest0-21swapper/307:25:043
3105499190,2cyclictest0-21swapper/212:09:042
3105499190,2cyclictest0-21swapper/211:37:042
3105499190,2cyclictest0-21swapper/211:34:062
3105499190,2cyclictest0-21swapper/208:22:012
3105399191,3cyclictest0-21swapper/110:54:351
3105399191,3cyclictest0-21swapper/110:35:141
3105399191,3cyclictest0-21swapper/107:50:181
3105399190,3cyclictest8936-21sendmail-mta08:56:071
3105399190,3cyclictest7736-21iostat_ios07:30:141
3105399190,3cyclictest703-21sh10:32:101
3105399190,3cyclictest4921-21sendmail-mta08:44:101
3105399190,3cyclictest29696-21ssh11:34:271
3105399190,3cyclictest27443-21awk10:26:031
3105399190,3cyclictest11172-21ssh10:42:421
3105399190,3cyclictest0-21swapper/111:18:341
3105399190,3cyclictest0-21swapper/110:18:381
3105399190,3cyclictest0-21swapper/110:18:381
3105399190,3cyclictest0-21swapper/109:21:031
3105399190,3cyclictest0-21swapper/108:23:581
31052991916,2cyclictest0-21swapper/007:45:110
3105599180,2cyclictest0-21swapper/308:16:053
3105499180,2cyclictest0-21swapper/207:43:052
3105399181,3cyclictest0-21swapper/110:56:271
3105399181,3cyclictest0-21swapper/108:50:171
3105399181,15cyclictest2849-21rs:main1
3105399180,3cyclictest8571-21fschecks_time09:35:151
3105399180,3cyclictest25266-21latency_hist08:15:001
3105399180,3cyclictest117162chrt11:48:351
3105399180,3cyclictest11317-21munin-node1
3105399180,17cyclictest0-21swapper/111:44:401
3105399180,16cyclictest31297-21latency_hist08:30:001
3105399175,3cyclictest7232-21cat08:50:001
3105399171,3cyclictest0-21swapper/109:33:291
3105399170,3cyclictest0-21swapper/108:15:171
199212170,0sleep00-21swapper/009:14:450
19432170,1sleep01946-21sendmail_mailtr07:16:010
75962160,0sleep00-21swapper/012:16:070
3105399164,3cyclictest4673-21sendmail-mta07:26:211
3105399161,3cyclictest0-21swapper/107:46:021
3105399161,13cyclictest17164-21munin-node1
3105399160,3cyclictest0-21swapper/107:21:021
3105399160,11cyclictest0-21swapper/107:36:071
3105499151,12cyclictest5578-21munin-node2
3105399151,3cyclictest0-21swapper/108:35:141
31052991510,3cyclictest0-21swapper/010:29:110
3105299150,2cyclictest0-21swapper/009:54:480
3105299150,13cyclictest0-21swapper/012:06:030
3105299150,13cyclictest0-21swapper/010:56:090
3105299150,13cyclictest0-21swapper/008:05:190
3105299149,3cyclictest24185-21ssh12:00:330
31052991411,2cyclictest0-21swapper/011:37:080
3105299141,11cyclictest6847-21ssh10:38:410
3105299141,11cyclictest15121-21diskmemload09:24:160
31052991410,2cyclictest0-21swapper/010:12:000
31052991410,2cyclictest0-21swapper/009:27:430
3105299140,2cyclictest0-21swapper/011:26:280
3105299140,13cyclictest0-21swapper/010:41:280
3105299140,13cyclictest0-21swapper/010:17:380
3105299140,13cyclictest0-21swapper/010:17:380
3105299140,12cyclictest15121-21diskmemload10:02:130
3105299140,12cyclictest0-21swapper/011:02:030
3105299140,12cyclictest0-21swapper/010:05:330
31054991310,2cyclictest0-21swapper/207:45:142
3105499130,2cyclictest0-21swapper/212:15:122
3105499130,12cyclictest0-21swapper/210:35:142
3105499130,11cyclictest15121-21diskmemload11:20:452
3105299138,3cyclictest16094-21hddtemp_smartct12:25:140
3105299138,3cyclictest13886-21wc09:40:160
3105299132,6cyclictest0-21swapper/008:55:000
31052991310,2cyclictest0-21swapper/012:34:010
31052991310,2cyclictest0-21swapper/012:23:470
31052991310,2cyclictest0-21swapper/011:47:390
31052991310,2cyclictest0-21swapper/011:31:410
31052991310,2cyclictest0-21swapper/011:15:000
31052991310,2cyclictest0-21swapper/010:48:480
31052991310,2cyclictest0-21swapper/010:33:200
31052991310,2cyclictest0-21swapper/009:35:200
31052991310,2cyclictest0-21swapper/008:20:010
3105299130,2cyclictest0-21swapper/011:58:280
3105299130,2cyclictest0-21swapper/011:21:390
3105299130,2cyclictest0-21swapper/008:02:490
3105299130,11cyclictest0-21swapper/011:51:220
3105599120,2cyclictest0-21swapper/309:03:043
3105299129,2cyclictest0-21swapper/011:40:420
3105299129,2cyclictest0-21swapper/010:51:280
3105299129,2cyclictest0-21swapper/009:15:130
3105299129,2cyclictest0-21swapper/009:05:120
3105299129,2cyclictest0-21swapper/008:31:030
3105299127,3cyclictest7070-21munin-run08:50:000
3105299122,8cyclictest6411-21grep07:26:030
3105299121,3cyclictest1304-21tr08:35:130
3105299120,2cyclictest0-21swapper/012:35:290
3105299120,2cyclictest0-21swapper/011:10:160
3105299120,2cyclictest0-21swapper/008:50:130
3105299120,2cyclictest0-21swapper/008:15:190
3105299120,11cyclictest0-21swapper/011:05:510
3105299120,11cyclictest0-21swapper/010:20:170
3105299120,11cyclictest0-21swapper/009:46:290
3105299120,11cyclictest0-21swapper/008:40:000
3105599110,10cyclictest0-21swapper/307:30:493
3105299118,2cyclictest0-21swapper/007:36:040
3105299116,3cyclictest29865-21sed08:25:130
3105299110,10cyclictest0-21swapper/008:14:390
3105299107,2cyclictest0-21swapper/007:14:100
3105299105,3cyclictest16805-21sendmail-mta07:55:170
3105299100,8cyclictest274-21jbd2/sda1-807:30:150
310559995,2cyclictest24161-21latency08:10:173
310559991,5cyclictest0-21swapper/307:50:003
310529996,2cyclictest0-21swapper/007:50:110
310529994,3cyclictest12309-21swap07:41:020
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional