[SPARK-7558] Demarcate tests in unit-tests.log #6441

andrewor14 · 2015-05-27T19:43:06Z

Right now unit-tests.log is not of much value because we can't tell where the test boundaries are easily. This patch adds log statements before and after each test to outline the test boundaries, e.g.:

===== TEST OUTPUT FOR o.a.s.serializer.KryoSerializerSuite: 'kryo with parallelize for primitive arrays' =====

15/05/27 12:36:39.596 pool-1-thread-1-ScalaTest-running-KryoSerializerSuite INFO SparkContext: Starting job: count at KryoSerializerSuite.scala:230
15/05/27 12:36:39.596 dag-scheduler-event-loop INFO DAGScheduler: Got job 3 (count at KryoSerializerSuite.scala:230) with 4 output partitions (allowLocal=false)
15/05/27 12:36:39.596 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 3(count at KryoSerializerSuite.scala:230)
15/05/27 12:36:39.596 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List()
15/05/27 12:36:39.597 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List()
15/05/27 12:36:39.597 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 3 (ParallelCollectionRDD[5] at parallelize at KryoSerializerSuite.scala:230), which has no missing parents

...

15/05/27 12:36:39.624 pool-1-thread-1-ScalaTest-running-KryoSerializerSuite INFO DAGScheduler: Job 3 finished: count at KryoSerializerSuite.scala:230, took 0.028563 s
15/05/27 12:36:39.625 pool-1-thread-1-ScalaTest-running-KryoSerializerSuite INFO KryoSerializerSuite:

===== FINISHED o.a.s.serializer.KryoSerializerSuite: 'kryo with parallelize for primitive arrays' =====

...

This is such that test suites in all modules can extend SparkFunSuite.

andrewor14 · 2015-05-27T19:43:44Z

@JoshRosen @pwendell

JoshRosen · 2015-05-27T20:04:35Z

Can we modify the style checker / linter to fail the build if someone commits a new test which uses FunSuite directly instead of using SparkFunSuite?

SparkQA · 2015-05-27T21:31:40Z

Test build #33608 has finished for PR 6441 at commit 35ee432.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

This is a big commit. In addition to just doing a search and replace there is actually more work to do in ensuring that the correct imports are introduced and the unused ones removed. This step is largely automated. :)

Conflicts: mllib/src/test/scala/org/apache/spark/ml/tuning/CrossValidatorSuite.scala sql/catalyst/src/test/scala/org/apache/spark/sql/types/DataTypeSuite.scala sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/CliSuite.scala

pwendell · 2015-05-27T22:46:49Z

Can you use the same patterns for the start and finish thresholds? Any reason to use === and then ***?

===== TEST OUTPUT FOR o.a.s.serializer.KryoSerializerSuite: 'kryo with parallelize for primitive arrays' =====
***** FINISHED o.a.s.serializer.KryoSerializerSuite: 'kryo with parallelize for primitive arrays' *****

andrewor14 · 2015-05-27T22:51:33Z

I can use the same one. Which one do you prefer?

SparkQA · 2015-05-27T23:46:50Z

Test build #33619 has finished for PR 6441 at commit 69cbb24.

This patch fails Spark unit tests.
This patch does not merge cleanly.
This patch adds the following public classes (experimental):
- class BagelSuite extends SparkFunSuite with Assertions with BeforeAndAfter with Timeouts
- class AccumulatorSuite extends SparkFunSuite with Matchers with LocalSparkContext
- class CheckpointSuite extends SparkFunSuite with LocalSparkContext with Logging
- class DistributedSuite extends SparkFunSuite with Matchers with LocalSparkContext
- class DriverSuite extends SparkFunSuite with Timeouts
- class FailureSuite extends SparkFunSuite with LocalSparkContext
- class FileServerSuite extends SparkFunSuite with LocalSparkContext
- class FileSuite extends SparkFunSuite with LocalSparkContext
- class HeartbeatReceiverSuite extends SparkFunSuite with LocalSparkContext
- class ImplicitOrderingSuite extends SparkFunSuite with LocalSparkContext
- class MapOutputTrackerSuite extends SparkFunSuite
- class PartitioningSuite extends SparkFunSuite with SharedSparkContext with PrivateMethodTester
- class SSLOptionsSuite extends SparkFunSuite with BeforeAndAfterAll
- class SecurityManagerSuite extends SparkFunSuite
- abstract class ShuffleSuite extends SparkFunSuite with Matchers with LocalSparkContext
- class SparkConfSuite extends SparkFunSuite with LocalSparkContext with ResetSystemProperties
- class SparkContextInfoSuite extends SparkFunSuite with LocalSparkContext
- class SparkContextSuite extends SparkFunSuite with LocalSparkContext
- * the
- class StatusTrackerSuite extends SparkFunSuite with Matchers with LocalSparkContext
- class ThreadingSuite extends SparkFunSuite with LocalSparkContext
- class UnpersistSuite extends SparkFunSuite with LocalSparkContext
- class PythonBroadcastSuite extends SparkFunSuite with Matchers with SharedSparkContext
- class PythonRDDSuite extends SparkFunSuite
- class SerDeUtilSuite extends SparkFunSuite with SharedSparkContext
- class BroadcastSuite extends SparkFunSuite with LocalSparkContext
- class ClientSuite extends SparkFunSuite with Matchers
- class JsonProtocolSuite extends SparkFunSuite with JsonTestUtils
- class LogUrlsStandaloneSuite extends SparkFunSuite with LocalSparkContext
- class PythonRunnerSuite extends SparkFunSuite
- class SparkSubmitUtilsSuite extends SparkFunSuite with BeforeAndAfterAll
- class FsHistoryProviderSuite extends SparkFunSuite with BeforeAndAfter with Matchers with Logging
- class MasterSuite extends SparkFunSuite with Matchers with Eventually
- class StandaloneRestSubmitSuite extends SparkFunSuite with BeforeAndAfterEach
- class SubmitRestProtocolSuite extends SparkFunSuite
- class CommandUtilsSuite extends SparkFunSuite with Matchers
- class DriverRunnerTest extends SparkFunSuite
- class ExecutorRunnerTest extends SparkFunSuite
- class WorkerArgumentsTest extends SparkFunSuite
- class WorkerSuite extends SparkFunSuite with Matchers
- class WorkerWatcherSuite extends SparkFunSuite
- class TaskMetricsSuite extends SparkFunSuite
- class WholeTextFileRecordReaderSuite extends SparkFunSuite with BeforeAndAfterAll
- class CompressionCodecSuite extends SparkFunSuite
- class MetricsConfigSuite extends SparkFunSuite with BeforeAndAfter
- class MetricsSystemSuite extends SparkFunSuite with BeforeAndAfter with PrivateMethodTester
- class NettyBlockTransferSecuritySuite extends SparkFunSuite with MockitoSugar with ShouldMatchers
- class ConnectionManagerSuite extends SparkFunSuite
- class AsyncRDDActionsSuite extends SparkFunSuite with BeforeAndAfterAll with Timeouts
- class DoubleRDDSuite extends SparkFunSuite with SharedSparkContext
- class JdbcRDDSuite extends SparkFunSuite with BeforeAndAfter with LocalSparkContext
- class PairRDDFunctionsSuite extends SparkFunSuite with SharedSparkContext
- class ParallelCollectionSplitSuite extends SparkFunSuite with Checkers
- class PartitionPruningRDDSuite extends SparkFunSuite with SharedSparkContext
- class PartitionwiseSampledRDDSuite extends SparkFunSuite with SharedSparkContext
- class PipedRDDSuite extends SparkFunSuite with SharedSparkContext
- class RDDOperationScopeSuite extends SparkFunSuite with BeforeAndAfter
- class RDDSuite extends SparkFunSuite with SharedSparkContext
- class SortingSuite extends SparkFunSuite with SharedSparkContext with Matchers with Logging
- class ZippedPartitionsSuite extends SparkFunSuite with SharedSparkContext
- abstract class RpcEnvSuite extends SparkFunSuite with BeforeAndAfterAll
- class CoarseGrainedSchedulerBackendSuite extends SparkFunSuite with LocalSparkContext
- class MapStatusSuite extends SparkFunSuite
- class OutputCommitCoordinatorSuite extends SparkFunSuite with BeforeAndAfter
- class PoolSuite extends SparkFunSuite with LocalSparkContext
- class ReplayListenerSuite extends SparkFunSuite with BeforeAndAfter
- class TaskContextSuite extends SparkFunSuite with BeforeAndAfter with LocalSparkContext
- class TaskResultGetterSuite extends SparkFunSuite with BeforeAndAfter with LocalSparkContext
- class TaskSchedulerImplSuite extends SparkFunSuite with LocalSparkContext with Logging
- class TaskSetManagerSuite extends SparkFunSuite with LocalSparkContext with Logging
- class MemoryUtilsSuite extends SparkFunSuite with MockitoSugar
- class MesosSchedulerBackendSuite extends SparkFunSuite with LocalSparkContext with MockitoSugar
- class MesosTaskLaunchDataSuite extends SparkFunSuite
- class MesosClusterSchedulerSuite extends SparkFunSuite with LocalSparkContext with MockitoSugar
- class JavaSerializerSuite extends SparkFunSuite
- class KryoSerializerDistributedSuite extends SparkFunSuite
- class KryoSerializerResizableOutputSuite extends SparkFunSuite
- class KryoSerializerSuite extends SparkFunSuite with SharedSparkContext
- class ProactiveClosureSerializationSuite extends SparkFunSuite with SharedSparkContext
- class SerializationDebuggerSuite extends SparkFunSuite with BeforeAndAfterEach
- class SerializerPropertiesSuite extends SparkFunSuite
- class ShuffleMemoryManagerSuite extends SparkFunSuite with Timeouts
- class HashShuffleManagerSuite extends SparkFunSuite with LocalSparkContext
- class UnsafeShuffleManagerSuite extends SparkFunSuite with Matchers
- class SimpleDateParamSuite extends SparkFunSuite with Matchers
- class BlockIdSuite extends SparkFunSuite
- class BlockManagerReplicationSuite extends SparkFunSuite with Matchers with BeforeAndAfter
- class BlockObjectWriterSuite extends SparkFunSuite
- class DiskBlockManagerSuite extends SparkFunSuite with BeforeAndAfterEach with BeforeAndAfterAll
- class FlatmapIteratorSuite extends SparkFunSuite with LocalSparkContext
- class LocalDirsSuite extends SparkFunSuite with BeforeAndAfter
- class ShuffleBlockFetcherIteratorSuite extends SparkFunSuite
- class StorageStatusListenerSuite extends SparkFunSuite
- class StorageSuite extends SparkFunSuite
- class UISeleniumSuite extends SparkFunSuite with WebBrowser with Matchers with BeforeAndAfterAll
- class UISuite extends SparkFunSuite
- class JobProgressListenerSuite extends SparkFunSuite with LocalSparkContext with Matchers
- class RDDOperationGraphListenerSuite extends SparkFunSuite
- class StorageTabSuite extends SparkFunSuite with BeforeAndAfter
- class AkkaUtilsSuite extends SparkFunSuite with LocalSparkContext with ResetSystemProperties
- class ClosureCleanerSuite extends SparkFunSuite
- class ClosureCleanerSuite2 extends SparkFunSuite with BeforeAndAfterAll with PrivateMethodTester
- class CompletionIteratorSuite extends SparkFunSuite
- class DistributionSuite extends SparkFunSuite with Matchers
- class EventLoopSuite extends SparkFunSuite with Timeouts
- class FileAppenderSuite extends SparkFunSuite with BeforeAndAfter with Logging
- class JsonProtocolSuite extends SparkFunSuite
- class MutableURLClassLoaderSuite extends SparkFunSuite
- class NextIteratorSuite extends SparkFunSuite with Matchers
- class ThreadUtilsSuite extends SparkFunSuite
- class TimeStampedHashMapSuite extends SparkFunSuite
- class UtilsSuite extends SparkFunSuite with ResetSystemProperties with Logging
- class VectorSuite extends SparkFunSuite
- class AppendOnlyMapSuite extends SparkFunSuite
- class BitSetSuite extends SparkFunSuite
- class ChainedBufferSuite extends SparkFunSuite
- class CompactBufferSuite extends SparkFunSuite
- class ExternalAppendOnlyMapSuite extends SparkFunSuite with LocalSparkContext
- class ExternalSorterSuite extends SparkFunSuite with LocalSparkContext with PrivateMethodTester
- class OpenHashMapSuite extends SparkFunSuite with Matchers
- class OpenHashSetSuite extends SparkFunSuite with Matchers
- class PartitionedSerializedPairBufferSuite extends SparkFunSuite
- class PrimitiveKeyOpenHashMapSuite extends SparkFunSuite with Matchers
- class PrimitiveVectorSuite extends SparkFunSuite
- class SizeTrackerSuite extends SparkFunSuite
- class SorterSuite extends SparkFunSuite
- class ByteArrayChunkOutputStreamSuite extends SparkFunSuite
- class RandomSamplerSuite extends SparkFunSuite with Matchers
- class SamplingUtilsSuite extends SparkFunSuite
- class XORShiftRandomSuite extends SparkFunSuite with Matchers
- class SparkSinkSuite extends SparkFunSuite
- class FlumePollingStreamSuite extends SparkFunSuite with BeforeAndAfter with Logging
- class FlumeStreamSuite extends SparkFunSuite with BeforeAndAfter with Matchers with Logging
- class KafkaClusterSuite extends SparkFunSuite with BeforeAndAfterAll
- class KafkaRDDSuite extends SparkFunSuite with BeforeAndAfterAll
- class KafkaStreamSuite extends SparkFunSuite with Eventually with BeforeAndAfterAll
- class MQTTStreamSuite extends SparkFunSuite with Eventually with BeforeAndAfter
- class TwitterStreamSuite extends SparkFunSuite with BeforeAndAfter with Logging
- class ZeroMQStreamSuite extends SparkFunSuite
- class EdgeRDDSuite extends SparkFunSuite with LocalSparkContext
- class EdgeSuite extends SparkFunSuite
- class GraphOpsSuite extends SparkFunSuite with LocalSparkContext
- class GraphSuite extends SparkFunSuite with LocalSparkContext
- class PregelSuite extends SparkFunSuite with LocalSparkContext
- class VertexRDDSuite extends SparkFunSuite with LocalSparkContext
- class EdgePartitionSuite extends SparkFunSuite
- class VertexPartitionSuite extends SparkFunSuite
- class ConnectedComponentsSuite extends SparkFunSuite with LocalSparkContext
- class LabelPropagationSuite extends SparkFunSuite with LocalSparkContext
- class PageRankSuite extends SparkFunSuite with LocalSparkContext
- class SVDPlusPlusSuite extends SparkFunSuite with LocalSparkContext
- class ShortestPathsSuite extends SparkFunSuite with LocalSparkContext
- class StronglyConnectedComponentsSuite extends SparkFunSuite with LocalSparkContext
- class TriangleCountSuite extends SparkFunSuite with LocalSparkContext
- class BytecodeUtilsSuite extends SparkFunSuite
- class GraphGeneratorsSuite extends SparkFunSuite with LocalSparkContext
- class IdentifiableSuite extends SparkFunSuite
- class PipelineSuite extends SparkFunSuite
- class AttributeGroupSuite extends SparkFunSuite
- class AttributeSuite extends SparkFunSuite
- class DecisionTreeClassifierSuite extends SparkFunSuite with MLlibTestSparkContext
- class GBTClassifierSuite extends SparkFunSuite with MLlibTestSparkContext
- class LogisticRegressionSuite extends SparkFunSuite with MLlibTestSparkContext
- class OneVsRestSuite extends SparkFunSuite with MLlibTestSparkContext
- class RandomForestClassifierSuite extends SparkFunSuite with MLlibTestSparkContext
- class RegressionEvaluatorSuite extends SparkFunSuite with MLlibTestSparkContext
- class BinarizerSuite extends SparkFunSuite with MLlibTestSparkContext
- class BucketizerSuite extends SparkFunSuite with MLlibTestSparkContext
- class HashingTFSuite extends SparkFunSuite with MLlibTestSparkContext
- class IDFSuite extends SparkFunSuite with MLlibTestSparkContext
- class NormalizerSuite extends SparkFunSuite with MLlibTestSparkContext
- class OneHotEncoderSuite extends SparkFunSuite with MLlibTestSparkContext
- class PolynomialExpansionSuite extends SparkFunSuite with MLlibTestSparkContext
- class StringIndexerSuite extends SparkFunSuite with MLlibTestSparkContext
- class RegexTokenizerSuite extends SparkFunSuite with MLlibTestSparkContext
- class VectorAssemblerSuite extends SparkFunSuite with MLlibTestSparkContext
- class VectorIndexerSuite extends SparkFunSuite with MLlibTestSparkContext
- class Word2VecSuite extends SparkFunSuite with MLlibTestSparkContext
- class ParamsSuite extends SparkFunSuite
- class SharedParamsSuite extends SparkFunSuite
- class ALSSuite extends SparkFunSuite with MLlibTestSparkContext with Logging
- class DecisionTreeRegressorSuite extends SparkFunSuite with MLlibTestSparkContext
- class GBTRegressorSuite extends SparkFunSuite with MLlibTestSparkContext
- class LinearRegressionSuite extends SparkFunSuite with MLlibTestSparkContext
- class RandomForestRegressorSuite extends SparkFunSuite with MLlibTestSparkContext
- class CrossValidatorSuite extends SparkFunSuite with MLlibTestSparkContext
- class ParamGridBuilderSuite extends SparkFunSuite
- class PythonMLLibAPISuite extends SparkFunSuite
- class LogisticRegressionSuite extends SparkFunSuite with MLlibTestSparkContext with Matchers
- class LogisticRegressionClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class NaiveBayesSuite extends SparkFunSuite with MLlibTestSparkContext
- class NaiveBayesClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class SVMSuite extends SparkFunSuite with MLlibTestSparkContext
- class SVMClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class StreamingLogisticRegressionSuite extends SparkFunSuite with TestSuiteBase
- class GaussianMixtureSuite extends SparkFunSuite with MLlibTestSparkContext
- class KMeansSuite extends SparkFunSuite with MLlibTestSparkContext
- class KMeansClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class LDASuite extends SparkFunSuite with MLlibTestSparkContext
- class PowerIterationClusteringSuite extends SparkFunSuite with MLlibTestSparkContext
- class StreamingKMeansSuite extends SparkFunSuite with TestSuiteBase
- class AreaUnderCurveSuite extends SparkFunSuite with MLlibTestSparkContext
- class BinaryClassificationMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
- class MulticlassMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
- class MultilabelMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
- class RankingMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
- class RegressionMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
- class ChiSqSelectorSuite extends SparkFunSuite with MLlibTestSparkContext
- class ElementwiseProductSuite extends SparkFunSuite with MLlibTestSparkContext
- class HashingTFSuite extends SparkFunSuite with MLlibTestSparkContext
- class IDFSuite extends SparkFunSuite with MLlibTestSparkContext
- class NormalizerSuite extends SparkFunSuite with MLlibTestSparkContext
- class PCASuite extends SparkFunSuite with MLlibTestSparkContext
- class StandardScalerSuite extends SparkFunSuite with MLlibTestSparkContext
- class Word2VecSuite extends SparkFunSuite with MLlibTestSparkContext
- class FPGrowthSuite extends SparkFunSuite with MLlibTestSparkContext
- class FPTreeSuite extends SparkFunSuite with MLlibTestSparkContext
- class PeriodicGraphCheckpointerSuite extends SparkFunSuite with MLlibTestSparkContext
- class BLASSuite extends SparkFunSuite
- class BreezeMatrixConversionSuite extends SparkFunSuite
- class BreezeVectorConversionSuite extends SparkFunSuite
- class MatricesSuite extends SparkFunSuite
- class VectorsSuite extends SparkFunSuite
- class BlockMatrixSuite extends SparkFunSuite with MLlibTestSparkContext
- class CoordinateMatrixSuite extends SparkFunSuite with MLlibTestSparkContext
- class IndexedRowMatrixSuite extends SparkFunSuite with MLlibTestSparkContext
- class RowMatrixSuite extends SparkFunSuite with MLlibTestSparkContext
- class RowMatrixClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class GradientDescentSuite extends SparkFunSuite with MLlibTestSparkContext with Matchers
- class GradientDescentClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class LBFGSSuite extends SparkFunSuite with MLlibTestSparkContext with Matchers
- class LBFGSClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class NNLSSuite extends SparkFunSuite
- class BinaryClassificationPMMLModelExportSuite extends SparkFunSuite
- class GeneralizedLinearPMMLModelExportSuite extends SparkFunSuite
- class KMeansPMMLModelExportSuite extends SparkFunSuite
- class PMMLModelExportFactorySuite extends SparkFunSuite
- class RandomDataGeneratorSuite extends SparkFunSuite
- class RandomRDDsSuite extends SparkFunSuite with MLlibTestSparkContext with Serializable
- class MLPairRDDFunctionsSuite extends SparkFunSuite with MLlibTestSparkContext
- class RDDFunctionsSuite extends SparkFunSuite with MLlibTestSparkContext
- class ALSSuite extends SparkFunSuite with MLlibTestSparkContext
- class MatrixFactorizationModelSuite extends SparkFunSuite with MLlibTestSparkContext
- class IsotonicRegressionSuite extends SparkFunSuite with MLlibTestSparkContext with Matchers
- class LabeledPointSuite extends SparkFunSuite
- class LassoSuite extends SparkFunSuite with MLlibTestSparkContext
- class LassoClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class LinearRegressionSuite extends SparkFunSuite with MLlibTestSparkContext
- class LinearRegressionClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class RidgeRegressionSuite extends SparkFunSuite with MLlibTestSparkContext
- class RidgeRegressionClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class StreamingLinearRegressionSuite extends SparkFunSuite with TestSuiteBase
- class CorrelationSuite extends SparkFunSuite with MLlibTestSparkContext
- class HypothesisTestSuite extends SparkFunSuite with MLlibTestSparkContext
- class KernelDensitySuite extends SparkFunSuite with MLlibTestSparkContext
- class MultivariateOnlineSummarizerSuite extends SparkFunSuite
- class MultivariateGaussianSuite extends SparkFunSuite with MLlibTestSparkContext
- class DecisionTreeSuite extends SparkFunSuite with MLlibTestSparkContext
- class GradientBoostedTreesSuite extends SparkFunSuite with MLlibTestSparkContext
- class ImpuritySuite extends SparkFunSuite with MLlibTestSparkContext
- class RandomForestSuite extends SparkFunSuite with MLlibTestSparkContext
- class BaggedPointSuite extends SparkFunSuite with MLlibTestSparkContext
- class MLUtilsSuite extends SparkFunSuite with MLlibTestSparkContext
- class NumericParserSuite extends SparkFunSuite
- class TestingUtilsSuite extends SparkFunSuite
- class ReplSuite extends SparkFunSuite
- class ReplSuite extends SparkFunSuite
- class DistributionSuite extends SparkFunSuite
- class ScalaReflectionSuite extends SparkFunSuite
- class SqlParserSuite extends SparkFunSuite
- class AnalysisSuite extends SparkFunSuite with BeforeAndAfter
- class DecimalPrecisionSuite extends SparkFunSuite with BeforeAndAfter
- class AttributeSetSuite extends SparkFunSuite
- class ExpressionEvaluationBaseSuite extends SparkFunSuite
- class UnsafeRowConverterSuite extends SparkFunSuite with Matchers
- class PlanTest extends SparkFunSuite
- class SameResultSuite extends SparkFunSuite
- class RuleExecutorSuite extends SparkFunSuite
- class TreeNodeSuite extends SparkFunSuite
- class MetadataSuite extends SparkFunSuite
- class DataTypeParserSuite extends SparkFunSuite
- class DataTypeSuite extends SparkFunSuite
- class UTF8StringSuite extends SparkFunSuite
- class DecimalSuite extends SparkFunSuite with PrivateMethodTester
- class DataFrameStatSuite extends SparkFunSuite
- class RowSuite extends SparkFunSuite
- class SQLConfSuite extends QueryTest
- class SQLContextSuite extends SparkFunSuite with BeforeAndAfterAll
- class ScalaReflectionRelationSuite extends SparkFunSuite
- class SerializationSuite extends SparkFunSuite
- class ColumnStatsSuite extends SparkFunSuite
- class ColumnTypeSuite extends SparkFunSuite with Logging
- class NullableColumnAccessorSuite extends SparkFunSuite
- class NullableColumnBuilderSuite extends SparkFunSuite
- class PartitionBatchPruningSuite extends SparkFunSuite with BeforeAndAfterAll with BeforeAndAfter
- class BooleanBitSetSuite extends SparkFunSuite
- class DictionaryEncodingSuite extends SparkFunSuite
- class IntegralDeltaSuite extends SparkFunSuite
- class RunLengthEncodingSuite extends SparkFunSuite
- class PlannerSuite extends SparkFunSuite
- class SparkSqlSerializer2DataTypeSuite extends SparkFunSuite
- class DebuggingSuite extends SparkFunSuite
- class HashedRelationSuite extends SparkFunSuite
- class JDBCSuite extends SparkFunSuite with BeforeAndAfter
- class JDBCWriteSuite extends SparkFunSuite with BeforeAndAfter
- class ParquetSchemaSuite extends SparkFunSuite with ParquetTest
- class ResolvedDataSourceSuite extends SparkFunSuite
- class CliSuite extends SparkFunSuite with BeforeAndAfter with Logging
- abstract class HiveThriftServer2Test extends SparkFunSuite with BeforeAndAfterAll with Logging
- class HiveInspectorSuite extends SparkFunSuite with HiveInspectors
- class HiveMetastoreCatalogSuite extends SparkFunSuite
- class HiveQlSuite extends SparkFunSuite with BeforeAndAfterAll
- class SerializationSuite extends SparkFunSuite
- class VersionsSuite extends SparkFunSuite with Logging
- class ConcurrentHiveSuite extends SparkFunSuite with BeforeAndAfterAll
- class OrcPartitionDiscoverySuite extends QueryTest with BeforeAndAfterAll
- class OrcQuerySuite extends QueryTest with BeforeAndAfterAll with OrcTest
- class CommitFailureTestRelationSuite extends SparkFunSuite with SQLTestUtils
- class DStreamClosureSuite extends SparkFunSuite with BeforeAndAfterAll
- class DStreamScopeSuite extends SparkFunSuite with BeforeAndAfter with BeforeAndAfterAll
- class StreamingContextSuite extends SparkFunSuite with BeforeAndAfter with Timeouts with Logging
- trait TestSuiteBase extends SparkFunSuite with BeforeAndAfter with Logging
- class InputInfoTrackerSuite extends SparkFunSuite with BeforeAndAfter
- class UIUtilsSuite extends SparkFunSuite with Matchers
- class RateLimitedOutputStreamSuite extends SparkFunSuite
- class WriteAheadLogSuite extends SparkFunSuite with BeforeAndAfter
- class ClientDistributedCacheManagerSuite extends SparkFunSuite with MockitoSugar
- class ClientSuite extends SparkFunSuite with Matchers with BeforeAndAfterAll
- class YarnAllocatorSuite extends SparkFunSuite with Matchers with BeforeAndAfterEach
- class YarnClusterSuite extends SparkFunSuite with BeforeAndAfterAll with Matchers with Logging
- class YarnSparkHadoopUtilSuite extends SparkFunSuite with Matchers with Logging

SparkQA · 2015-05-28T00:02:18Z

Test build #33621 has finished for PR 6441 at commit fa9450e.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

SparkQA · 2015-05-28T02:09:53Z

Test build #33630 has finished for PR 6441 at commit ee22cda.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
- class BagelSuite extends SparkFunSuite with Assertions with BeforeAndAfter with Timeouts
- class AccumulatorSuite extends SparkFunSuite with Matchers with LocalSparkContext
- class CheckpointSuite extends SparkFunSuite with LocalSparkContext with Logging
- class DistributedSuite extends SparkFunSuite with Matchers with LocalSparkContext
- class DriverSuite extends SparkFunSuite with Timeouts
- class FailureSuite extends SparkFunSuite with LocalSparkContext
- class FileServerSuite extends SparkFunSuite with LocalSparkContext
- class FileSuite extends SparkFunSuite with LocalSparkContext
- class HeartbeatReceiverSuite extends SparkFunSuite with LocalSparkContext
- class ImplicitOrderingSuite extends SparkFunSuite with LocalSparkContext
- class MapOutputTrackerSuite extends SparkFunSuite
- class PartitioningSuite extends SparkFunSuite with SharedSparkContext with PrivateMethodTester
- class SSLOptionsSuite extends SparkFunSuite with BeforeAndAfterAll
- class SecurityManagerSuite extends SparkFunSuite
- abstract class ShuffleSuite extends SparkFunSuite with Matchers with LocalSparkContext
- class SparkConfSuite extends SparkFunSuite with LocalSparkContext with ResetSystemProperties
- class SparkContextInfoSuite extends SparkFunSuite with LocalSparkContext
- class SparkContextSuite extends SparkFunSuite with LocalSparkContext
- * the
- class StatusTrackerSuite extends SparkFunSuite with Matchers with LocalSparkContext
- class ThreadingSuite extends SparkFunSuite with LocalSparkContext
- class UnpersistSuite extends SparkFunSuite with LocalSparkContext
- class PythonBroadcastSuite extends SparkFunSuite with Matchers with SharedSparkContext
- class PythonRDDSuite extends SparkFunSuite
- class SerDeUtilSuite extends SparkFunSuite with SharedSparkContext
- class BroadcastSuite extends SparkFunSuite with LocalSparkContext
- class ClientSuite extends SparkFunSuite with Matchers
- class JsonProtocolSuite extends SparkFunSuite with JsonTestUtils
- class LogUrlsStandaloneSuite extends SparkFunSuite with LocalSparkContext
- class PythonRunnerSuite extends SparkFunSuite
- class SparkSubmitUtilsSuite extends SparkFunSuite with BeforeAndAfterAll
- class FsHistoryProviderSuite extends SparkFunSuite with BeforeAndAfter with Matchers with Logging
- class MasterSuite extends SparkFunSuite with Matchers with Eventually
- class StandaloneRestSubmitSuite extends SparkFunSuite with BeforeAndAfterEach
- class SubmitRestProtocolSuite extends SparkFunSuite
- class CommandUtilsSuite extends SparkFunSuite with Matchers
- class DriverRunnerTest extends SparkFunSuite
- class ExecutorRunnerTest extends SparkFunSuite
- class WorkerArgumentsTest extends SparkFunSuite
- class WorkerSuite extends SparkFunSuite with Matchers
- class WorkerWatcherSuite extends SparkFunSuite
- class TaskMetricsSuite extends SparkFunSuite
- class WholeTextFileRecordReaderSuite extends SparkFunSuite with BeforeAndAfterAll
- class CompressionCodecSuite extends SparkFunSuite
- class MetricsConfigSuite extends SparkFunSuite with BeforeAndAfter
- class MetricsSystemSuite extends SparkFunSuite with BeforeAndAfter with PrivateMethodTester
- class NettyBlockTransferSecuritySuite extends SparkFunSuite with MockitoSugar with ShouldMatchers
- class ConnectionManagerSuite extends SparkFunSuite
- class AsyncRDDActionsSuite extends SparkFunSuite with BeforeAndAfterAll with Timeouts
- class DoubleRDDSuite extends SparkFunSuite with SharedSparkContext
- class JdbcRDDSuite extends SparkFunSuite with BeforeAndAfter with LocalSparkContext
- class PairRDDFunctionsSuite extends SparkFunSuite with SharedSparkContext
- class ParallelCollectionSplitSuite extends SparkFunSuite with Checkers
- class PartitionPruningRDDSuite extends SparkFunSuite with SharedSparkContext
- class PartitionwiseSampledRDDSuite extends SparkFunSuite with SharedSparkContext
- class PipedRDDSuite extends SparkFunSuite with SharedSparkContext
- class RDDOperationScopeSuite extends SparkFunSuite with BeforeAndAfter
- class RDDSuite extends SparkFunSuite with SharedSparkContext
- class SortingSuite extends SparkFunSuite with SharedSparkContext with Matchers with Logging
- class ZippedPartitionsSuite extends SparkFunSuite with SharedSparkContext
- abstract class RpcEnvSuite extends SparkFunSuite with BeforeAndAfterAll
- class CoarseGrainedSchedulerBackendSuite extends SparkFunSuite with LocalSparkContext
- class MapStatusSuite extends SparkFunSuite
- class OutputCommitCoordinatorSuite extends SparkFunSuite with BeforeAndAfter
- class PoolSuite extends SparkFunSuite with LocalSparkContext
- class ReplayListenerSuite extends SparkFunSuite with BeforeAndAfter
- class TaskContextSuite extends SparkFunSuite with BeforeAndAfter with LocalSparkContext
- class TaskResultGetterSuite extends SparkFunSuite with BeforeAndAfter with LocalSparkContext
- class TaskSchedulerImplSuite extends SparkFunSuite with LocalSparkContext with Logging
- class TaskSetManagerSuite extends SparkFunSuite with LocalSparkContext with Logging
- class MemoryUtilsSuite extends SparkFunSuite with MockitoSugar
- class MesosSchedulerBackendSuite extends SparkFunSuite with LocalSparkContext with MockitoSugar
- class MesosTaskLaunchDataSuite extends SparkFunSuite
- class MesosClusterSchedulerSuite extends SparkFunSuite with LocalSparkContext with MockitoSugar
- class JavaSerializerSuite extends SparkFunSuite
- class KryoSerializerDistributedSuite extends SparkFunSuite
- class KryoSerializerResizableOutputSuite extends SparkFunSuite
- class KryoSerializerSuite extends SparkFunSuite with SharedSparkContext
- class ProactiveClosureSerializationSuite extends SparkFunSuite with SharedSparkContext
- class SerializationDebuggerSuite extends SparkFunSuite with BeforeAndAfterEach
- class SerializerPropertiesSuite extends SparkFunSuite
- class ShuffleMemoryManagerSuite extends SparkFunSuite with Timeouts
- class HashShuffleManagerSuite extends SparkFunSuite with LocalSparkContext
- class UnsafeShuffleManagerSuite extends SparkFunSuite with Matchers
- class SimpleDateParamSuite extends SparkFunSuite with Matchers
- class BlockIdSuite extends SparkFunSuite
- class BlockManagerReplicationSuite extends SparkFunSuite with Matchers with BeforeAndAfter
- class BlockObjectWriterSuite extends SparkFunSuite
- class DiskBlockManagerSuite extends SparkFunSuite with BeforeAndAfterEach with BeforeAndAfterAll
- class FlatmapIteratorSuite extends SparkFunSuite with LocalSparkContext
- class LocalDirsSuite extends SparkFunSuite with BeforeAndAfter
- class ShuffleBlockFetcherIteratorSuite extends SparkFunSuite
- class StorageStatusListenerSuite extends SparkFunSuite
- class StorageSuite extends SparkFunSuite
- class UISeleniumSuite extends SparkFunSuite with WebBrowser with Matchers with BeforeAndAfterAll
- class UISuite extends SparkFunSuite
- class JobProgressListenerSuite extends SparkFunSuite with LocalSparkContext with Matchers
- class RDDOperationGraphListenerSuite extends SparkFunSuite
- class StorageTabSuite extends SparkFunSuite with BeforeAndAfter
- class AkkaUtilsSuite extends SparkFunSuite with LocalSparkContext with ResetSystemProperties
- class ClosureCleanerSuite extends SparkFunSuite
- class ClosureCleanerSuite2 extends SparkFunSuite with BeforeAndAfterAll with PrivateMethodTester
- class CompletionIteratorSuite extends SparkFunSuite
- class DistributionSuite extends SparkFunSuite with Matchers
- class EventLoopSuite extends SparkFunSuite with Timeouts
- class FileAppenderSuite extends SparkFunSuite with BeforeAndAfter with Logging
- class JsonProtocolSuite extends SparkFunSuite
- class MutableURLClassLoaderSuite extends SparkFunSuite
- class NextIteratorSuite extends SparkFunSuite with Matchers
- class ThreadUtilsSuite extends SparkFunSuite
- class TimeStampedHashMapSuite extends SparkFunSuite
- class UtilsSuite extends SparkFunSuite with ResetSystemProperties with Logging
- class VectorSuite extends SparkFunSuite
- class AppendOnlyMapSuite extends SparkFunSuite
- class BitSetSuite extends SparkFunSuite
- class ChainedBufferSuite extends SparkFunSuite
- class CompactBufferSuite extends SparkFunSuite
- class ExternalAppendOnlyMapSuite extends SparkFunSuite with LocalSparkContext
- class ExternalSorterSuite extends SparkFunSuite with LocalSparkContext with PrivateMethodTester
- class OpenHashMapSuite extends SparkFunSuite with Matchers
- class OpenHashSetSuite extends SparkFunSuite with Matchers
- class PartitionedSerializedPairBufferSuite extends SparkFunSuite
- class PrimitiveKeyOpenHashMapSuite extends SparkFunSuite with Matchers
- class PrimitiveVectorSuite extends SparkFunSuite
- class SizeTrackerSuite extends SparkFunSuite
- class SorterSuite extends SparkFunSuite
- class ByteArrayChunkOutputStreamSuite extends SparkFunSuite
- class RandomSamplerSuite extends SparkFunSuite with Matchers
- class SamplingUtilsSuite extends SparkFunSuite
- class XORShiftRandomSuite extends SparkFunSuite with Matchers
- class SparkSinkSuite extends SparkFunSuite
- class FlumePollingStreamSuite extends SparkFunSuite with BeforeAndAfter with Logging
- class FlumeStreamSuite extends SparkFunSuite with BeforeAndAfter with Matchers with Logging
- class KafkaClusterSuite extends SparkFunSuite with BeforeAndAfterAll
- class KafkaRDDSuite extends SparkFunSuite with BeforeAndAfterAll
- class KafkaStreamSuite extends SparkFunSuite with Eventually with BeforeAndAfterAll
- class MQTTStreamSuite extends SparkFunSuite with Eventually with BeforeAndAfter
- class TwitterStreamSuite extends SparkFunSuite with BeforeAndAfter with Logging
- class ZeroMQStreamSuite extends SparkFunSuite
- class EdgeRDDSuite extends SparkFunSuite with LocalSparkContext
- class EdgeSuite extends SparkFunSuite
- class GraphOpsSuite extends SparkFunSuite with LocalSparkContext
- class GraphSuite extends SparkFunSuite with LocalSparkContext
- class PregelSuite extends SparkFunSuite with LocalSparkContext
- class VertexRDDSuite extends SparkFunSuite with LocalSparkContext
- class EdgePartitionSuite extends SparkFunSuite
- class VertexPartitionSuite extends SparkFunSuite
- class ConnectedComponentsSuite extends SparkFunSuite with LocalSparkContext
- class LabelPropagationSuite extends SparkFunSuite with LocalSparkContext
- class PageRankSuite extends SparkFunSuite with LocalSparkContext
- class SVDPlusPlusSuite extends SparkFunSuite with LocalSparkContext
- class ShortestPathsSuite extends SparkFunSuite with LocalSparkContext
- class StronglyConnectedComponentsSuite extends SparkFunSuite with LocalSparkContext
- class TriangleCountSuite extends SparkFunSuite with LocalSparkContext
- class BytecodeUtilsSuite extends SparkFunSuite
- class GraphGeneratorsSuite extends SparkFunSuite with LocalSparkContext
- class IdentifiableSuite extends SparkFunSuite
- class PipelineSuite extends SparkFunSuite
- class AttributeGroupSuite extends SparkFunSuite
- class AttributeSuite extends SparkFunSuite
- class DecisionTreeClassifierSuite extends SparkFunSuite with MLlibTestSparkContext
- class GBTClassifierSuite extends SparkFunSuite with MLlibTestSparkContext
- class LogisticRegressionSuite extends SparkFunSuite with MLlibTestSparkContext
- class OneVsRestSuite extends SparkFunSuite with MLlibTestSparkContext
- class RandomForestClassifierSuite extends SparkFunSuite with MLlibTestSparkContext
- class RegressionEvaluatorSuite extends SparkFunSuite with MLlibTestSparkContext
- class BinarizerSuite extends SparkFunSuite with MLlibTestSparkContext
- class BucketizerSuite extends SparkFunSuite with MLlibTestSparkContext
- class HashingTFSuite extends SparkFunSuite with MLlibTestSparkContext
- class IDFSuite extends SparkFunSuite with MLlibTestSparkContext
- class NormalizerSuite extends SparkFunSuite with MLlibTestSparkContext
- class OneHotEncoderSuite extends SparkFunSuite with MLlibTestSparkContext
- class PolynomialExpansionSuite extends SparkFunSuite with MLlibTestSparkContext
- class StringIndexerSuite extends SparkFunSuite with MLlibTestSparkContext
- class RegexTokenizerSuite extends SparkFunSuite with MLlibTestSparkContext
- class VectorAssemblerSuite extends SparkFunSuite with MLlibTestSparkContext
- class VectorIndexerSuite extends SparkFunSuite with MLlibTestSparkContext
- class Word2VecSuite extends SparkFunSuite with MLlibTestSparkContext
- class ParamsSuite extends SparkFunSuite
- class SharedParamsSuite extends SparkFunSuite
- class ALSSuite extends SparkFunSuite with MLlibTestSparkContext with Logging
- class DecisionTreeRegressorSuite extends SparkFunSuite with MLlibTestSparkContext
- class GBTRegressorSuite extends SparkFunSuite with MLlibTestSparkContext
- class LinearRegressionSuite extends SparkFunSuite with MLlibTestSparkContext
- class RandomForestRegressorSuite extends SparkFunSuite with MLlibTestSparkContext
- class CrossValidatorSuite extends SparkFunSuite with MLlibTestSparkContext
- class ParamGridBuilderSuite extends SparkFunSuite
- class PythonMLLibAPISuite extends SparkFunSuite
- class LogisticRegressionSuite extends SparkFunSuite with MLlibTestSparkContext with Matchers
- class LogisticRegressionClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class NaiveBayesSuite extends SparkFunSuite with MLlibTestSparkContext
- class NaiveBayesClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class SVMSuite extends SparkFunSuite with MLlibTestSparkContext
- class SVMClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class StreamingLogisticRegressionSuite extends SparkFunSuite with TestSuiteBase
- class GaussianMixtureSuite extends SparkFunSuite with MLlibTestSparkContext
- class KMeansSuite extends SparkFunSuite with MLlibTestSparkContext
- class KMeansClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class LDASuite extends SparkFunSuite with MLlibTestSparkContext
- class PowerIterationClusteringSuite extends SparkFunSuite with MLlibTestSparkContext
- class StreamingKMeansSuite extends SparkFunSuite with TestSuiteBase
- class AreaUnderCurveSuite extends SparkFunSuite with MLlibTestSparkContext
- class BinaryClassificationMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
- class MulticlassMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
- class MultilabelMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
- class RankingMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
- class RegressionMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
- class ChiSqSelectorSuite extends SparkFunSuite with MLlibTestSparkContext
- class ElementwiseProductSuite extends SparkFunSuite with MLlibTestSparkContext
- class HashingTFSuite extends SparkFunSuite with MLlibTestSparkContext
- class IDFSuite extends SparkFunSuite with MLlibTestSparkContext
- class NormalizerSuite extends SparkFunSuite with MLlibTestSparkContext
- class PCASuite extends SparkFunSuite with MLlibTestSparkContext
- class StandardScalerSuite extends SparkFunSuite with MLlibTestSparkContext
- class Word2VecSuite extends SparkFunSuite with MLlibTestSparkContext
- class FPGrowthSuite extends SparkFunSuite with MLlibTestSparkContext
- class FPTreeSuite extends SparkFunSuite with MLlibTestSparkContext
- class PeriodicGraphCheckpointerSuite extends SparkFunSuite with MLlibTestSparkContext
- class BLASSuite extends SparkFunSuite
- class BreezeMatrixConversionSuite extends SparkFunSuite
- class BreezeVectorConversionSuite extends SparkFunSuite
- class MatricesSuite extends SparkFunSuite
- class VectorsSuite extends SparkFunSuite
- class BlockMatrixSuite extends SparkFunSuite with MLlibTestSparkContext
- class CoordinateMatrixSuite extends SparkFunSuite with MLlibTestSparkContext
- class IndexedRowMatrixSuite extends SparkFunSuite with MLlibTestSparkContext
- class RowMatrixSuite extends SparkFunSuite with MLlibTestSparkContext
- class RowMatrixClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class GradientDescentSuite extends SparkFunSuite with MLlibTestSparkContext with Matchers
- class GradientDescentClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class LBFGSSuite extends SparkFunSuite with MLlibTestSparkContext with Matchers
- class LBFGSClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class NNLSSuite extends SparkFunSuite
- class BinaryClassificationPMMLModelExportSuite extends SparkFunSuite
- class GeneralizedLinearPMMLModelExportSuite extends SparkFunSuite
- class KMeansPMMLModelExportSuite extends SparkFunSuite
- class PMMLModelExportFactorySuite extends SparkFunSuite
- class RandomDataGeneratorSuite extends SparkFunSuite
- class RandomRDDsSuite extends SparkFunSuite with MLlibTestSparkContext with Serializable
- class MLPairRDDFunctionsSuite extends SparkFunSuite with MLlibTestSparkContext
- class RDDFunctionsSuite extends SparkFunSuite with MLlibTestSparkContext
- class ALSSuite extends SparkFunSuite with MLlibTestSparkContext
- class MatrixFactorizationModelSuite extends SparkFunSuite with MLlibTestSparkContext
- class IsotonicRegressionSuite extends SparkFunSuite with MLlibTestSparkContext with Matchers
- class LabeledPointSuite extends SparkFunSuite
- class LassoSuite extends SparkFunSuite with MLlibTestSparkContext
- class LassoClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class LinearRegressionSuite extends SparkFunSuite with MLlibTestSparkContext
- class LinearRegressionClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class RidgeRegressionSuite extends SparkFunSuite with MLlibTestSparkContext
- class RidgeRegressionClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class StreamingLinearRegressionSuite extends SparkFunSuite with TestSuiteBase
- class CorrelationSuite extends SparkFunSuite with MLlibTestSparkContext
- class HypothesisTestSuite extends SparkFunSuite with MLlibTestSparkContext
- class KernelDensitySuite extends SparkFunSuite with MLlibTestSparkContext
- class MultivariateOnlineSummarizerSuite extends SparkFunSuite
- class MultivariateGaussianSuite extends SparkFunSuite with MLlibTestSparkContext
- class DecisionTreeSuite extends SparkFunSuite with MLlibTestSparkContext
- class GradientBoostedTreesSuite extends SparkFunSuite with MLlibTestSparkContext
- class ImpuritySuite extends SparkFunSuite with MLlibTestSparkContext
- class RandomForestSuite extends SparkFunSuite with MLlibTestSparkContext
- class BaggedPointSuite extends SparkFunSuite with MLlibTestSparkContext
- class MLUtilsSuite extends SparkFunSuite with MLlibTestSparkContext
- class NumericParserSuite extends SparkFunSuite
- class TestingUtilsSuite extends SparkFunSuite
- class ReplSuite extends SparkFunSuite
- class ReplSuite extends SparkFunSuite
- class DistributionSuite extends SparkFunSuite
- class ScalaReflectionSuite extends SparkFunSuite
- class SqlParserSuite extends SparkFunSuite
- class AnalysisSuite extends SparkFunSuite with BeforeAndAfter
- class DecimalPrecisionSuite extends SparkFunSuite with BeforeAndAfter
- class AttributeSetSuite extends SparkFunSuite
- class ExpressionEvaluationBaseSuite extends SparkFunSuite
- class UnsafeRowConverterSuite extends SparkFunSuite with Matchers
- class PlanTest extends SparkFunSuite
- class SameResultSuite extends SparkFunSuite
- class RuleExecutorSuite extends SparkFunSuite
- class TreeNodeSuite extends SparkFunSuite
- class MetadataSuite extends SparkFunSuite
- class DataTypeParserSuite extends SparkFunSuite
- class DataTypeSuite extends SparkFunSuite
- class UTF8StringSuite extends SparkFunSuite
- class DecimalSuite extends SparkFunSuite with PrivateMethodTester
- class DataFrameStatSuite extends SparkFunSuite
- class RowSuite extends SparkFunSuite
- class SQLConfSuite extends QueryTest
- class SQLContextSuite extends SparkFunSuite with BeforeAndAfterAll
- class ScalaReflectionRelationSuite extends SparkFunSuite
- class SerializationSuite extends SparkFunSuite
- class ColumnStatsSuite extends SparkFunSuite
- class ColumnTypeSuite extends SparkFunSuite with Logging
- class NullableColumnAccessorSuite extends SparkFunSuite
- class NullableColumnBuilderSuite extends SparkFunSuite
- class PartitionBatchPruningSuite extends SparkFunSuite with BeforeAndAfterAll with BeforeAndAfter
- class BooleanBitSetSuite extends SparkFunSuite
- class DictionaryEncodingSuite extends SparkFunSuite
- class IntegralDeltaSuite extends SparkFunSuite
- class RunLengthEncodingSuite extends SparkFunSuite
- class PlannerSuite extends SparkFunSuite
- class SparkSqlSerializer2DataTypeSuite extends SparkFunSuite
- class DebuggingSuite extends SparkFunSuite
- class HashedRelationSuite extends SparkFunSuite
- class JDBCSuite extends SparkFunSuite with BeforeAndAfter
- class JDBCWriteSuite extends SparkFunSuite with BeforeAndAfter
- class ParquetSchemaSuite extends SparkFunSuite with ParquetTest
- class ResolvedDataSourceSuite extends SparkFunSuite
- class CliSuite extends SparkFunSuite with BeforeAndAfter with Logging
- abstract class HiveThriftServer2Test extends SparkFunSuite with BeforeAndAfterAll with Logging
- class HiveInspectorSuite extends SparkFunSuite with HiveInspectors
- class HiveMetastoreCatalogSuite extends SparkFunSuite
- class HiveQlSuite extends SparkFunSuite with BeforeAndAfterAll
- class SerializationSuite extends SparkFunSuite
- class VersionsSuite extends SparkFunSuite with Logging
- class ConcurrentHiveSuite extends SparkFunSuite with BeforeAndAfterAll
- class OrcPartitionDiscoverySuite extends QueryTest with BeforeAndAfterAll
- class OrcQuerySuite extends QueryTest with BeforeAndAfterAll with OrcTest
- class CommitFailureTestRelationSuite extends SparkFunSuite with SQLTestUtils
- class DStreamClosureSuite extends SparkFunSuite with BeforeAndAfterAll
- class DStreamScopeSuite extends SparkFunSuite with BeforeAndAfter with BeforeAndAfterAll
- class StreamingContextSuite extends SparkFunSuite with BeforeAndAfter with Timeouts with Logging
- trait TestSuiteBase extends SparkFunSuite with BeforeAndAfter with Logging
- class InputInfoTrackerSuite extends SparkFunSuite with BeforeAndAfter
- class UIUtilsSuite extends SparkFunSuite with Matchers
- class RateLimitedOutputStreamSuite extends SparkFunSuite
- class WriteAheadLogSuite extends SparkFunSuite with BeforeAndAfter
- class ClientDistributedCacheManagerSuite extends SparkFunSuite with MockitoSugar
- class ClientSuite extends SparkFunSuite with Matchers with BeforeAndAfterAll
- class YarnAllocatorSuite extends SparkFunSuite with Matchers with BeforeAndAfterEach
- class YarnClusterSuite extends SparkFunSuite with BeforeAndAfterAll with Matchers with Logging
- class YarnSparkHadoopUtilSuite extends SparkFunSuite with Matchers with Logging

andrewor14 · 2015-05-28T03:56:23Z

I dug into this a bit about why this is failing. It turns out that core/test depends on guava 15 (from tachyon), while core depends on guava 14. The full error message is a java.lang.IllegalAccessError complaining that a certain method in guava cannot be accessed; this is frequently caused by classpath issues.

In commit da0b12f we made catalyst/test depend on core/test. This is a problem since hive/test depends on catalyst/test, so we are indirectly packaging guava 15 into hive tests.

pwendell · 2015-05-28T03:59:41Z

Can we exclude guava from tachyon in the test dependency?

Patrick

On Wed, May 27, 2015 at 8:56 PM, andrewor14 [email protected]
wrote:

I dug into this a bit about why this is failing. It turns out that
core/test depends on guava 15 (from tachyon), while core depends on guava
14. The full error message is a java.lang.IllegalAccessError complaining
that a certain method in guava cannot be accessed; this is frequently
caused by classpath issues.

In commit da0b12f
da0b12f
we made catalyst/test depend on core/test. This is a problem since
hive/test depends on catalyst/test, so we are indirectly packaging guava
15 into hive tests.

—
Reply to this email directly or view it on GitHub
#6441 (comment).

andrewor14 · 2015-05-28T04:00:18Z

Yeah I'm doing that right now

In core/test, it turns out that selenium is bringing in guava 15, but the rest of Spark we use guava 14, which is evicted. Since we made catalyst/test depend on core/test, and hive/test depends on catalyst/test, hive tests are getting guava 15, which results in java.lang.IllegalAccessError because of a dependency conflict. This is resolved by excluding guava 15 from selenium in core/test.

andrewor14 · 2015-05-28T04:23:14Z

Alright, it turns out that it was selenium, not tachyon, that was bundling guava 15. I tested out the latest changes locally and tests should now pass.

andrewor14 · 2015-05-28T04:24:45Z

@JoshRosen that's a great suggestion, though one that I would prefer to implement after the test scripts are converted to python (ongoing at #5694) so we don't introduce another merge conflict.

SparkQA · 2015-05-28T04:43:56Z

Test build #33643 has finished for PR 6441 at commit 8882581.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
- class BagelSuite extends SparkFunSuite with Assertions with BeforeAndAfter with Timeouts
- class AccumulatorSuite extends SparkFunSuite with Matchers with LocalSparkContext
- class CheckpointSuite extends SparkFunSuite with LocalSparkContext with Logging
- class DistributedSuite extends SparkFunSuite with Matchers with LocalSparkContext
- class DriverSuite extends SparkFunSuite with Timeouts
- class FailureSuite extends SparkFunSuite with LocalSparkContext
- class FileServerSuite extends SparkFunSuite with LocalSparkContext
- class FileSuite extends SparkFunSuite with LocalSparkContext
- class HeartbeatReceiverSuite extends SparkFunSuite with LocalSparkContext
- class ImplicitOrderingSuite extends SparkFunSuite with LocalSparkContext
- class MapOutputTrackerSuite extends SparkFunSuite
- class PartitioningSuite extends SparkFunSuite with SharedSparkContext with PrivateMethodTester
- class SSLOptionsSuite extends SparkFunSuite with BeforeAndAfterAll
- class SecurityManagerSuite extends SparkFunSuite
- abstract class ShuffleSuite extends SparkFunSuite with Matchers with LocalSparkContext
- class SparkConfSuite extends SparkFunSuite with LocalSparkContext with ResetSystemProperties
- class SparkContextInfoSuite extends SparkFunSuite with LocalSparkContext
- class SparkContextSuite extends SparkFunSuite with LocalSparkContext
- * the
- class StatusTrackerSuite extends SparkFunSuite with Matchers with LocalSparkContext
- class ThreadingSuite extends SparkFunSuite with LocalSparkContext
- class UnpersistSuite extends SparkFunSuite with LocalSparkContext
- class PythonBroadcastSuite extends SparkFunSuite with Matchers with SharedSparkContext
- class PythonRDDSuite extends SparkFunSuite
- class SerDeUtilSuite extends SparkFunSuite with SharedSparkContext
- class BroadcastSuite extends SparkFunSuite with LocalSparkContext
- class ClientSuite extends SparkFunSuite with Matchers
- class JsonProtocolSuite extends SparkFunSuite with JsonTestUtils
- class LogUrlsStandaloneSuite extends SparkFunSuite with LocalSparkContext
- class PythonRunnerSuite extends SparkFunSuite
- class SparkSubmitUtilsSuite extends SparkFunSuite with BeforeAndAfterAll
- class FsHistoryProviderSuite extends SparkFunSuite with BeforeAndAfter with Matchers with Logging
- class MasterSuite extends SparkFunSuite with Matchers with Eventually
- class StandaloneRestSubmitSuite extends SparkFunSuite with BeforeAndAfterEach
- class SubmitRestProtocolSuite extends SparkFunSuite
- class CommandUtilsSuite extends SparkFunSuite with Matchers
- class DriverRunnerTest extends SparkFunSuite
- class ExecutorRunnerTest extends SparkFunSuite
- class WorkerArgumentsTest extends SparkFunSuite
- class WorkerSuite extends SparkFunSuite with Matchers
- class WorkerWatcherSuite extends SparkFunSuite
- class TaskMetricsSuite extends SparkFunSuite
- class WholeTextFileRecordReaderSuite extends SparkFunSuite with BeforeAndAfterAll
- class CompressionCodecSuite extends SparkFunSuite
- class MetricsConfigSuite extends SparkFunSuite with BeforeAndAfter
- class MetricsSystemSuite extends SparkFunSuite with BeforeAndAfter with PrivateMethodTester
- class NettyBlockTransferSecuritySuite extends SparkFunSuite with MockitoSugar with ShouldMatchers
- class ConnectionManagerSuite extends SparkFunSuite
- class AsyncRDDActionsSuite extends SparkFunSuite with BeforeAndAfterAll with Timeouts
- class DoubleRDDSuite extends SparkFunSuite with SharedSparkContext
- class JdbcRDDSuite extends SparkFunSuite with BeforeAndAfter with LocalSparkContext
- class PairRDDFunctionsSuite extends SparkFunSuite with SharedSparkContext
- class ParallelCollectionSplitSuite extends SparkFunSuite with Checkers
- class PartitionPruningRDDSuite extends SparkFunSuite with SharedSparkContext
- class PartitionwiseSampledRDDSuite extends SparkFunSuite with SharedSparkContext
- class PipedRDDSuite extends SparkFunSuite with SharedSparkContext
- class RDDOperationScopeSuite extends SparkFunSuite with BeforeAndAfter
- class RDDSuite extends SparkFunSuite with SharedSparkContext
- class SortingSuite extends SparkFunSuite with SharedSparkContext with Matchers with Logging
- class ZippedPartitionsSuite extends SparkFunSuite with SharedSparkContext
- abstract class RpcEnvSuite extends SparkFunSuite with BeforeAndAfterAll
- class CoarseGrainedSchedulerBackendSuite extends SparkFunSuite with LocalSparkContext
- class MapStatusSuite extends SparkFunSuite
- class OutputCommitCoordinatorSuite extends SparkFunSuite with BeforeAndAfter
- class PoolSuite extends SparkFunSuite with LocalSparkContext
- class ReplayListenerSuite extends SparkFunSuite with BeforeAndAfter
- class TaskContextSuite extends SparkFunSuite with BeforeAndAfter with LocalSparkContext
- class TaskResultGetterSuite extends SparkFunSuite with BeforeAndAfter with LocalSparkContext
- class TaskSchedulerImplSuite extends SparkFunSuite with LocalSparkContext with Logging
- class TaskSetManagerSuite extends SparkFunSuite with LocalSparkContext with Logging
- class MemoryUtilsSuite extends SparkFunSuite with MockitoSugar
- class MesosSchedulerBackendSuite extends SparkFunSuite with LocalSparkContext with MockitoSugar
- class MesosTaskLaunchDataSuite extends SparkFunSuite
- class MesosClusterSchedulerSuite extends SparkFunSuite with LocalSparkContext with MockitoSugar
- class JavaSerializerSuite extends SparkFunSuite
- class KryoSerializerDistributedSuite extends SparkFunSuite
- class KryoSerializerResizableOutputSuite extends SparkFunSuite
- class KryoSerializerSuite extends SparkFunSuite with SharedSparkContext
- class ProactiveClosureSerializationSuite extends SparkFunSuite with SharedSparkContext
- class SerializationDebuggerSuite extends SparkFunSuite with BeforeAndAfterEach
- class SerializerPropertiesSuite extends SparkFunSuite
- class ShuffleMemoryManagerSuite extends SparkFunSuite with Timeouts
- class HashShuffleManagerSuite extends SparkFunSuite with LocalSparkContext
- class UnsafeShuffleManagerSuite extends SparkFunSuite with Matchers
- class SimpleDateParamSuite extends SparkFunSuite with Matchers
- class BlockIdSuite extends SparkFunSuite
- class BlockManagerReplicationSuite extends SparkFunSuite with Matchers with BeforeAndAfter
- class BlockObjectWriterSuite extends SparkFunSuite
- class DiskBlockManagerSuite extends SparkFunSuite with BeforeAndAfterEach with BeforeAndAfterAll
- class FlatmapIteratorSuite extends SparkFunSuite with LocalSparkContext
- class LocalDirsSuite extends SparkFunSuite with BeforeAndAfter
- class ShuffleBlockFetcherIteratorSuite extends SparkFunSuite
- class StorageStatusListenerSuite extends SparkFunSuite
- class StorageSuite extends SparkFunSuite
- class UISeleniumSuite extends SparkFunSuite with WebBrowser with Matchers with BeforeAndAfterAll
- class UISuite extends SparkFunSuite
- class JobProgressListenerSuite extends SparkFunSuite with LocalSparkContext with Matchers
- class RDDOperationGraphListenerSuite extends SparkFunSuite
- class StorageTabSuite extends SparkFunSuite with BeforeAndAfter
- class AkkaUtilsSuite extends SparkFunSuite with LocalSparkContext with ResetSystemProperties
- class ClosureCleanerSuite extends SparkFunSuite
- class ClosureCleanerSuite2 extends SparkFunSuite with BeforeAndAfterAll with PrivateMethodTester
- class CompletionIteratorSuite extends SparkFunSuite
- class DistributionSuite extends SparkFunSuite with Matchers
- class EventLoopSuite extends SparkFunSuite with Timeouts
- class FileAppenderSuite extends SparkFunSuite with BeforeAndAfter with Logging
- class JsonProtocolSuite extends SparkFunSuite
- class MutableURLClassLoaderSuite extends SparkFunSuite
- class NextIteratorSuite extends SparkFunSuite with Matchers
- class ThreadUtilsSuite extends SparkFunSuite
- class TimeStampedHashMapSuite extends SparkFunSuite
- class UtilsSuite extends SparkFunSuite with ResetSystemProperties with Logging
- class VectorSuite extends SparkFunSuite
- class AppendOnlyMapSuite extends SparkFunSuite
- class BitSetSuite extends SparkFunSuite
- class ChainedBufferSuite extends SparkFunSuite
- class CompactBufferSuite extends SparkFunSuite
- class ExternalAppendOnlyMapSuite extends SparkFunSuite with LocalSparkContext
- class ExternalSorterSuite extends SparkFunSuite with LocalSparkContext with PrivateMethodTester
- class OpenHashMapSuite extends SparkFunSuite with Matchers
- class OpenHashSetSuite extends SparkFunSuite with Matchers
- class PartitionedSerializedPairBufferSuite extends SparkFunSuite
- class PrimitiveKeyOpenHashMapSuite extends SparkFunSuite with Matchers
- class PrimitiveVectorSuite extends SparkFunSuite
- class SizeTrackerSuite extends SparkFunSuite
- class SorterSuite extends SparkFunSuite
- class ByteArrayChunkOutputStreamSuite extends SparkFunSuite
- class RandomSamplerSuite extends SparkFunSuite with Matchers
- class SamplingUtilsSuite extends SparkFunSuite
- class XORShiftRandomSuite extends SparkFunSuite with Matchers
- class SparkSinkSuite extends SparkFunSuite
- class FlumePollingStreamSuite extends SparkFunSuite with BeforeAndAfter with Logging
- class FlumeStreamSuite extends SparkFunSuite with BeforeAndAfter with Matchers with Logging
- class KafkaClusterSuite extends SparkFunSuite with BeforeAndAfterAll
- class KafkaRDDSuite extends SparkFunSuite with BeforeAndAfterAll
- class KafkaStreamSuite extends SparkFunSuite with Eventually with BeforeAndAfterAll
- class MQTTStreamSuite extends SparkFunSuite with Eventually with BeforeAndAfter
- class TwitterStreamSuite extends SparkFunSuite with BeforeAndAfter with Logging
- class ZeroMQStreamSuite extends SparkFunSuite
- class EdgeRDDSuite extends SparkFunSuite with LocalSparkContext
- class EdgeSuite extends SparkFunSuite
- class GraphOpsSuite extends SparkFunSuite with LocalSparkContext
- class GraphSuite extends SparkFunSuite with LocalSparkContext
- class PregelSuite extends SparkFunSuite with LocalSparkContext
- class VertexRDDSuite extends SparkFunSuite with LocalSparkContext
- class EdgePartitionSuite extends SparkFunSuite
- class VertexPartitionSuite extends SparkFunSuite
- class ConnectedComponentsSuite extends SparkFunSuite with LocalSparkContext
- class LabelPropagationSuite extends SparkFunSuite with LocalSparkContext
- class PageRankSuite extends SparkFunSuite with LocalSparkContext
- class SVDPlusPlusSuite extends SparkFunSuite with LocalSparkContext
- class ShortestPathsSuite extends SparkFunSuite with LocalSparkContext
- class StronglyConnectedComponentsSuite extends SparkFunSuite with LocalSparkContext
- class TriangleCountSuite extends SparkFunSuite with LocalSparkContext
- class BytecodeUtilsSuite extends SparkFunSuite
- class GraphGeneratorsSuite extends SparkFunSuite with LocalSparkContext
- class IdentifiableSuite extends SparkFunSuite
- class PipelineSuite extends SparkFunSuite
- class AttributeGroupSuite extends SparkFunSuite
- class AttributeSuite extends SparkFunSuite
- class DecisionTreeClassifierSuite extends SparkFunSuite with MLlibTestSparkContext
- class GBTClassifierSuite extends SparkFunSuite with MLlibTestSparkContext
- class LogisticRegressionSuite extends SparkFunSuite with MLlibTestSparkContext
- class OneVsRestSuite extends SparkFunSuite with MLlibTestSparkContext
- class RandomForestClassifierSuite extends SparkFunSuite with MLlibTestSparkContext
- class RegressionEvaluatorSuite extends SparkFunSuite with MLlibTestSparkContext
- class BinarizerSuite extends SparkFunSuite with MLlibTestSparkContext
- class BucketizerSuite extends SparkFunSuite with MLlibTestSparkContext
- class HashingTFSuite extends SparkFunSuite with MLlibTestSparkContext
- class IDFSuite extends SparkFunSuite with MLlibTestSparkContext
- class NormalizerSuite extends SparkFunSuite with MLlibTestSparkContext
- class OneHotEncoderSuite extends SparkFunSuite with MLlibTestSparkContext
- class PolynomialExpansionSuite extends SparkFunSuite with MLlibTestSparkContext
- class StringIndexerSuite extends SparkFunSuite with MLlibTestSparkContext
- class RegexTokenizerSuite extends SparkFunSuite with MLlibTestSparkContext
- class VectorAssemblerSuite extends SparkFunSuite with MLlibTestSparkContext
- class VectorIndexerSuite extends SparkFunSuite with MLlibTestSparkContext
- class Word2VecSuite extends SparkFunSuite with MLlibTestSparkContext
- class ParamsSuite extends SparkFunSuite
- class SharedParamsSuite extends SparkFunSuite
- class ALSSuite extends SparkFunSuite with MLlibTestSparkContext with Logging
- class DecisionTreeRegressorSuite extends SparkFunSuite with MLlibTestSparkContext
- class GBTRegressorSuite extends SparkFunSuite with MLlibTestSparkContext
- class LinearRegressionSuite extends SparkFunSuite with MLlibTestSparkContext
- class RandomForestRegressorSuite extends SparkFunSuite with MLlibTestSparkContext
- class CrossValidatorSuite extends SparkFunSuite with MLlibTestSparkContext
- class ParamGridBuilderSuite extends SparkFunSuite
- class PythonMLLibAPISuite extends SparkFunSuite
- class LogisticRegressionSuite extends SparkFunSuite with MLlibTestSparkContext with Matchers
- class LogisticRegressionClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class NaiveBayesSuite extends SparkFunSuite with MLlibTestSparkContext
- class NaiveBayesClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class SVMSuite extends SparkFunSuite with MLlibTestSparkContext
- class SVMClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class StreamingLogisticRegressionSuite extends SparkFunSuite with TestSuiteBase
- class GaussianMixtureSuite extends SparkFunSuite with MLlibTestSparkContext
- class KMeansSuite extends SparkFunSuite with MLlibTestSparkContext
- class KMeansClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class LDASuite extends SparkFunSuite with MLlibTestSparkContext
- class PowerIterationClusteringSuite extends SparkFunSuite with MLlibTestSparkContext
- class StreamingKMeansSuite extends SparkFunSuite with TestSuiteBase
- class AreaUnderCurveSuite extends SparkFunSuite with MLlibTestSparkContext
- class BinaryClassificationMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
- class MulticlassMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
- class MultilabelMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
- class RankingMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
- class RegressionMetricsSuite extends SparkFunSuite with MLlibTestSparkContext
- class ChiSqSelectorSuite extends SparkFunSuite with MLlibTestSparkContext
- class ElementwiseProductSuite extends SparkFunSuite with MLlibTestSparkContext
- class HashingTFSuite extends SparkFunSuite with MLlibTestSparkContext
- class IDFSuite extends SparkFunSuite with MLlibTestSparkContext
- class NormalizerSuite extends SparkFunSuite with MLlibTestSparkContext
- class PCASuite extends SparkFunSuite with MLlibTestSparkContext
- class StandardScalerSuite extends SparkFunSuite with MLlibTestSparkContext
- class Word2VecSuite extends SparkFunSuite with MLlibTestSparkContext
- class FPGrowthSuite extends SparkFunSuite with MLlibTestSparkContext
- class FPTreeSuite extends SparkFunSuite with MLlibTestSparkContext
- class PeriodicGraphCheckpointerSuite extends SparkFunSuite with MLlibTestSparkContext
- class BLASSuite extends SparkFunSuite
- class BreezeMatrixConversionSuite extends SparkFunSuite
- class BreezeVectorConversionSuite extends SparkFunSuite
- class MatricesSuite extends SparkFunSuite
- class VectorsSuite extends SparkFunSuite
- class BlockMatrixSuite extends SparkFunSuite with MLlibTestSparkContext
- class CoordinateMatrixSuite extends SparkFunSuite with MLlibTestSparkContext
- class IndexedRowMatrixSuite extends SparkFunSuite with MLlibTestSparkContext
- class RowMatrixSuite extends SparkFunSuite with MLlibTestSparkContext
- class RowMatrixClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class GradientDescentSuite extends SparkFunSuite with MLlibTestSparkContext with Matchers
- class GradientDescentClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class LBFGSSuite extends SparkFunSuite with MLlibTestSparkContext with Matchers
- class LBFGSClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class NNLSSuite extends SparkFunSuite
- class BinaryClassificationPMMLModelExportSuite extends SparkFunSuite
- class GeneralizedLinearPMMLModelExportSuite extends SparkFunSuite
- class KMeansPMMLModelExportSuite extends SparkFunSuite
- class PMMLModelExportFactorySuite extends SparkFunSuite
- class RandomDataGeneratorSuite extends SparkFunSuite
- class RandomRDDsSuite extends SparkFunSuite with MLlibTestSparkContext with Serializable
- class MLPairRDDFunctionsSuite extends SparkFunSuite with MLlibTestSparkContext
- class RDDFunctionsSuite extends SparkFunSuite with MLlibTestSparkContext
- class ALSSuite extends SparkFunSuite with MLlibTestSparkContext
- class MatrixFactorizationModelSuite extends SparkFunSuite with MLlibTestSparkContext
- class IsotonicRegressionSuite extends SparkFunSuite with MLlibTestSparkContext with Matchers
- class LabeledPointSuite extends SparkFunSuite
- class LassoSuite extends SparkFunSuite with MLlibTestSparkContext
- class LassoClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class LinearRegressionSuite extends SparkFunSuite with MLlibTestSparkContext
- class LinearRegressionClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class RidgeRegressionSuite extends SparkFunSuite with MLlibTestSparkContext
- class RidgeRegressionClusterSuite extends SparkFunSuite with LocalClusterSparkContext
- class StreamingLinearRegressionSuite extends SparkFunSuite with TestSuiteBase
- class CorrelationSuite extends SparkFunSuite with MLlibTestSparkContext
- class HypothesisTestSuite extends SparkFunSuite with MLlibTestSparkContext
- class KernelDensitySuite extends SparkFunSuite with MLlibTestSparkContext
- class MultivariateOnlineSummarizerSuite extends SparkFunSuite
- class MultivariateGaussianSuite extends SparkFunSuite with MLlibTestSparkContext
- class DecisionTreeSuite extends SparkFunSuite with MLlibTestSparkContext
- class GradientBoostedTreesSuite extends SparkFunSuite with MLlibTestSparkContext
- class ImpuritySuite extends SparkFunSuite with MLlibTestSparkContext
- class RandomForestSuite extends SparkFunSuite with MLlibTestSparkContext
- class BaggedPointSuite extends SparkFunSuite with MLlibTestSparkContext
- class MLUtilsSuite extends SparkFunSuite with MLlibTestSparkContext
- class NumericParserSuite extends SparkFunSuite
- class TestingUtilsSuite extends SparkFunSuite
- class ReplSuite extends SparkFunSuite
- class ReplSuite extends SparkFunSuite
- class DistributionSuite extends SparkFunSuite
- class ScalaReflectionSuite extends SparkFunSuite
- class SqlParserSuite extends SparkFunSuite
- class AnalysisSuite extends SparkFunSuite with BeforeAndAfter
- class DecimalPrecisionSuite extends SparkFunSuite with BeforeAndAfter
- class AttributeSetSuite extends SparkFunSuite
- class ExpressionEvaluationBaseSuite extends SparkFunSuite
- class UnsafeRowConverterSuite extends SparkFunSuite with Matchers
- class PlanTest extends SparkFunSuite
- class SameResultSuite extends SparkFunSuite
- class RuleExecutorSuite extends SparkFunSuite
- class TreeNodeSuite extends SparkFunSuite
- class MetadataSuite extends SparkFunSuite
- class DataTypeParserSuite extends SparkFunSuite
- class DataTypeSuite extends SparkFunSuite
- class UTF8StringSuite extends SparkFunSuite
- class DecimalSuite extends SparkFunSuite with PrivateMethodTester
- class DataFrameStatSuite extends SparkFunSuite
- class RowSuite extends SparkFunSuite
- class SQLConfSuite extends QueryTest
- class SQLContextSuite extends SparkFunSuite with BeforeAndAfterAll
- class ScalaReflectionRelationSuite extends SparkFunSuite
- class SerializationSuite extends SparkFunSuite
- class ColumnStatsSuite extends SparkFunSuite
- class ColumnTypeSuite extends SparkFunSuite with Logging
- class NullableColumnAccessorSuite extends SparkFunSuite
- class NullableColumnBuilderSuite extends SparkFunSuite
- class PartitionBatchPruningSuite extends SparkFunSuite with BeforeAndAfterAll with BeforeAndAfter
- class BooleanBitSetSuite extends SparkFunSuite
- class DictionaryEncodingSuite extends SparkFunSuite
- class IntegralDeltaSuite extends SparkFunSuite
- class RunLengthEncodingSuite extends SparkFunSuite
- class PlannerSuite extends SparkFunSuite
- class SparkSqlSerializer2DataTypeSuite extends SparkFunSuite
- class DebuggingSuite extends SparkFunSuite
- class HashedRelationSuite extends SparkFunSuite
- class JDBCSuite extends SparkFunSuite with BeforeAndAfter
- class JDBCWriteSuite extends SparkFunSuite with BeforeAndAfter
- class ParquetSchemaSuite extends SparkFunSuite with ParquetTest
- class ResolvedDataSourceSuite extends SparkFunSuite
- class CliSuite extends SparkFunSuite with BeforeAndAfter with Logging
- abstract class HiveThriftServer2Test extends SparkFunSuite with BeforeAndAfterAll with Logging
- class HiveInspectorSuite extends SparkFunSuite with HiveInspectors
- class HiveMetastoreCatalogSuite extends SparkFunSuite
- class HiveQlSuite extends SparkFunSuite with BeforeAndAfterAll
- class SerializationSuite extends SparkFunSuite
- class VersionsSuite extends SparkFunSuite with Logging
- class ConcurrentHiveSuite extends SparkFunSuite with BeforeAndAfterAll
- class OrcPartitionDiscoverySuite extends QueryTest with BeforeAndAfterAll
- class OrcQuerySuite extends QueryTest with BeforeAndAfterAll with OrcTest
- class CommitFailureTestRelationSuite extends SparkFunSuite with SQLTestUtils
- class DStreamClosureSuite extends SparkFunSuite with BeforeAndAfterAll
- class DStreamScopeSuite extends SparkFunSuite with BeforeAndAfter with BeforeAndAfterAll
- class StreamingContextSuite extends SparkFunSuite with BeforeAndAfter with Timeouts with Logging
- trait TestSuiteBase extends SparkFunSuite with BeforeAndAfter with Logging
- class InputInfoTrackerSuite extends SparkFunSuite with BeforeAndAfter
- class UIUtilsSuite extends SparkFunSuite with Matchers
- class RateLimitedOutputStreamSuite extends SparkFunSuite
- class WriteAheadLogSuite extends SparkFunSuite with BeforeAndAfter
- class ClientDistributedCacheManagerSuite extends SparkFunSuite with MockitoSugar
- class ClientSuite extends SparkFunSuite with Matchers with BeforeAndAfterAll
- class YarnAllocatorSuite extends SparkFunSuite with Matchers with BeforeAndAfterEach
- class YarnClusterSuite extends SparkFunSuite with BeforeAndAfterAll with Matchers with Logging
- class YarnSparkHadoopUtilSuite extends SparkFunSuite with Matchers with Logging

JoshRosen · 2015-05-28T04:54:38Z

Yeah, probably best to introduce the error / warning gradually, too, since I suspect it would cause a lot of build breaks if we merge PRs that are passing tests w/o retesting with the new build.

SparkQA · 2015-05-28T06:32:59Z

Test build #33646 has finished for PR 6441 at commit c43ffc4.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

andrewor14 · 2015-05-28T19:38:03Z

Latest set of tests failed because a new test suite was merged into master in an existing test file :).
This is now fixed as of the latest commit.

SparkQA · 2015-05-29T20:49:36Z

Test build #33756 timed out for PR 6441 at commit d622af7 after a configured wait of 150m.

andrewor14 · 2015-05-29T21:02:54Z

The last tests actually passed (see commit order). I'm merging this into master. If there are follow-up fixes or comments let's address it separately. Thanks everyone.

Tests compile in SBT but not Maven.

Note that this patch reverts the changes in flume-sink because this module does not currently depend on Spark core, but the tests require it. There is not an easy way to make this work because mvn test dependencies are not transitive (MNG-1378). For now, we will leave the one test suite in flume-sink out until we figure out a better solution. This patch is mainly intended to unbreak the maven build.

This patch fixes a build break in maven caused by #6441. Note that this patch reverts the changes in flume-sink because this module does not currently depend on Spark core, but the tests require it. There is not an easy way to make this work because mvn test dependencies are not transitive (MNG-1378). For now, we will leave the one test suite in flume-sink out until we figure out a better solution. This patch is mainly intended to unbreak the maven build. Author: Andrew Or <[email protected]> Closes #6511 from andrewor14/fix-build-mvn and squashes the following commits: 3d53643 [Andrew Or] [HOT FIX #6441] Fix maven build failures

andrewor14 · 2015-05-30T00:22:06Z

Note to self: when we backport this later remember to also backport:

hive-thriftserver test fix: 4782e13
hotfix1: 8c99793
hotfix2: a4f2412
scalastyle check: 609c492

This is a follow-up patch to #6441. Author: Andrew Or <[email protected]> Closes #6510 from andrewor14/extends-funsuite-check and squashes the following commits: 6618b46 [Andrew Or] Exempt SparkSinkSuite from the FunSuite check 99d02ac [Andrew Or] Merge branch 'master' of github.com:apache/spark into extends-funsuite-check 48874dd [Andrew Or] Guard against direct uses of FunSuite / FunSuiteLike

steveloughran · 2015-06-01T13:23:39Z

Regarding backporting, it could be enough to start with copying {{SparkFunSuite}} into 1.3 & 1.4 branches, so that any new patches written against trunk can be applied to those branches without any rewrites being needed. You wouldn't need to patch the existing tests for that, just have new tests switch to it even in the older branches

This is a follow-up patch to apache#6441. Author: Andrew Or <[email protected]> Closes apache#6510 from andrewor14/extends-funsuite-check and squashes the following commits: 6618b46 [Andrew Or] Exempt SparkSinkSuite from the FunSuite check 99d02ac [Andrew Or] Merge branch 'master' of github.com:apache/spark into extends-funsuite-check 48874dd [Andrew Or] Guard against direct uses of FunSuite / FunSuiteLike

This is a follow-up patch to apache#6441. Author: Andrew Or <[email protected]> Closes apache#6510 from andrewor14/extends-funsuite-check and squashes the following commits: 6618b46 [Andrew Or] Exempt SparkSinkSuite from the FunSuite check 99d02ac [Andrew Or] Merge branch 'master' of github.com:apache/spark into extends-funsuite-check 48874dd [Andrew Or] Guard against direct uses of FunSuite / FunSuiteLike Conflicts: scalastyle-config.xml

This includes the following commits: original: 9eb222c hotfix1: 8c99793 hotfix2: a4f2412 scalastyle check: 609c492 --- Original patch #6441 Branch-1.4 patch #6598 Author: Andrew Or <[email protected]> Closes #6602 from andrewor14/demarcate-tests-1.3 and squashes the following commits: a75ff8f [Andrew Or] Fix hive-thrift server log4j problem f782edd [Andrew Or] [SPARK-7558] Guard against direct uses of FunSuite / FunSuiteLike 2b7a4f4 [Andrew Or] Fix tests? fec05c2 [Andrew Or] Fix tests 5342d50 [Andrew Or] Various whitespace changes (minor) 9af2756 [Andrew Or] Make all test suites extend SparkFunSuite instead of FunSuite 192a47c [Andrew Or] Fix log message 95ff5eb [Andrew Or] Add core tests as dependencies in all modules 8dffa0e [Andrew Or] Introduce base abstract class for all test suites

This includes the following commits: original: 9eb222c hotfix1: 8c99793 hotfix2: a4f2412 scalastyle check: 609c492 --- Original patch #6441 Branch-1.3 patch #6602 Author: Andrew Or <[email protected]> Closes #6598 from andrewor14/demarcate-tests-1.4 and squashes the following commits: 4c3c566 [Andrew Or] Merge branch 'branch-1.4' of github.com:apache/spark into demarcate-tests-1.4 e217b78 [Andrew Or] [SPARK-7558] Guard against direct uses of FunSuite / FunSuiteLike 46d4361 [Andrew Or] Various whitespace changes (minor) 3d9bf04 [Andrew Or] Make all test suites extend SparkFunSuite instead of FunSuite eaa520e [Andrew Or] Fix tests? b4d93de [Andrew Or] Fix tests 634a777 [Andrew Or] Fix log message a932e8d [Andrew Or] Fix manual things that cannot be covered through automation 8bc355d [Andrew Or] Add core tests as dependencies in all modules 75d361f [Andrew Or] Introduce base abstract class for all test suites

Right now `unit-tests.log` are not of much value because we can't tell where the test boundaries are easily. This patch adds log statements before and after each test to outline the test boundaries, e.g.: ``` ===== TEST OUTPUT FOR o.a.s.serializer.KryoSerializerSuite: 'kryo with parallelize for primitive arrays' ===== 15/05/27 12:36:39.596 pool-1-thread-1-ScalaTest-running-KryoSerializerSuite INFO SparkContext: Starting job: count at KryoSerializerSuite.scala:230 15/05/27 12:36:39.596 dag-scheduler-event-loop INFO DAGScheduler: Got job 3 (count at KryoSerializerSuite.scala:230) with 4 output partitions (allowLocal=false) 15/05/27 12:36:39.596 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 3(count at KryoSerializerSuite.scala:230) 15/05/27 12:36:39.596 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 15/05/27 12:36:39.597 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 15/05/27 12:36:39.597 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 3 (ParallelCollectionRDD[5] at parallelize at KryoSerializerSuite.scala:230), which has no missing parents ... 15/05/27 12:36:39.624 pool-1-thread-1-ScalaTest-running-KryoSerializerSuite INFO DAGScheduler: Job 3 finished: count at KryoSerializerSuite.scala:230, took 0.028563 s 15/05/27 12:36:39.625 pool-1-thread-1-ScalaTest-running-KryoSerializerSuite INFO KryoSerializerSuite: ***** FINISHED o.a.s.serializer.KryoSerializerSuite: 'kryo with parallelize for primitive arrays' ***** ... ``` Author: Andrew Or <[email protected]> Closes apache#6441 from andrewor14/demarcate-tests and squashes the following commits: 879b060 [Andrew Or] Fix compile after rebase d622af7 [Andrew Or] Merge branch 'master' of github.com:apache/spark into demarcate-tests 017c8ba [Andrew Or] Merge branch 'master' of github.com:apache/spark into demarcate-tests 7790b6c [Andrew Or] Fix tests after logical merge conflict c7460c0 [Andrew Or] Merge branch 'master' of github.com:apache/spark into demarcate-tests c43ffc4 [Andrew Or] Fix tests? 8882581 [Andrew Or] Fix tests ee22cda [Andrew Or] Fix log message fa9450e [Andrew Or] Merge branch 'master' of github.com:apache/spark into demarcate-tests 12d1e1b [Andrew Or] Various whitespace changes (minor) 69cbb24 [Andrew Or] Make all test suites extend SparkFunSuite instead of FunSuite bbce12e [Andrew Or] Fix manual things that cannot be covered through automation da0b12f [Andrew Or] Add core tests as dependencies in all modules f7d29ce [Andrew Or] Introduce base abstract class for all test suites

This patch fixes a build break in maven caused by apache#6441. Note that this patch reverts the changes in flume-sink because this module does not currently depend on Spark core, but the tests require it. There is not an easy way to make this work because mvn test dependencies are not transitive (MNG-1378). For now, we will leave the one test suite in flume-sink out until we figure out a better solution. This patch is mainly intended to unbreak the maven build. Author: Andrew Or <[email protected]> Closes apache#6511 from andrewor14/fix-build-mvn and squashes the following commits: 3d53643 [Andrew Or] [HOT FIX apache#6441] Fix maven build failures

This is a follow-up patch to apache#6441. Author: Andrew Or <[email protected]> Closes apache#6510 from andrewor14/extends-funsuite-check and squashes the following commits: 6618b46 [Andrew Or] Exempt SparkSinkSuite from the FunSuite check 99d02ac [Andrew Or] Merge branch 'master' of github.com:apache/spark into extends-funsuite-check 48874dd [Andrew Or] Guard against direct uses of FunSuite / FunSuiteLike

Right now `unit-tests.log` are not of much value because we can't tell where the test boundaries are easily. This patch adds log statements before and after each test to outline the test boundaries, e.g.: ``` ===== TEST OUTPUT FOR o.a.s.serializer.KryoSerializerSuite: 'kryo with parallelize for primitive arrays' ===== 15/05/27 12:36:39.596 pool-1-thread-1-ScalaTest-running-KryoSerializerSuite INFO SparkContext: Starting job: count at KryoSerializerSuite.scala:230 15/05/27 12:36:39.596 dag-scheduler-event-loop INFO DAGScheduler: Got job 3 (count at KryoSerializerSuite.scala:230) with 4 output partitions (allowLocal=false) 15/05/27 12:36:39.596 dag-scheduler-event-loop INFO DAGScheduler: Final stage: ResultStage 3(count at KryoSerializerSuite.scala:230) 15/05/27 12:36:39.596 dag-scheduler-event-loop INFO DAGScheduler: Parents of final stage: List() 15/05/27 12:36:39.597 dag-scheduler-event-loop INFO DAGScheduler: Missing parents: List() 15/05/27 12:36:39.597 dag-scheduler-event-loop INFO DAGScheduler: Submitting ResultStage 3 (ParallelCollectionRDD[5] at parallelize at KryoSerializerSuite.scala:230), which has no missing parents ... 15/05/27 12:36:39.624 pool-1-thread-1-ScalaTest-running-KryoSerializerSuite INFO DAGScheduler: Job 3 finished: count at KryoSerializerSuite.scala:230, took 0.028563 s 15/05/27 12:36:39.625 pool-1-thread-1-ScalaTest-running-KryoSerializerSuite INFO KryoSerializerSuite: ***** FINISHED o.a.s.serializer.KryoSerializerSuite: 'kryo with parallelize for primitive arrays' ***** ... ``` Author: Andrew Or <[email protected]> Closes apache#6441 from andrewor14/demarcate-tests and squashes the following commits: 879b060 [Andrew Or] Fix compile after rebase d622af7 [Andrew Or] Merge branch 'master' of github.com:apache/spark into demarcate-tests 017c8ba [Andrew Or] Merge branch 'master' of github.com:apache/spark into demarcate-tests 7790b6c [Andrew Or] Fix tests after logical merge conflict c7460c0 [Andrew Or] Merge branch 'master' of github.com:apache/spark into demarcate-tests c43ffc4 [Andrew Or] Fix tests? 8882581 [Andrew Or] Fix tests ee22cda [Andrew Or] Fix log message fa9450e [Andrew Or] Merge branch 'master' of github.com:apache/spark into demarcate-tests 12d1e1b [Andrew Or] Various whitespace changes (minor) 69cbb24 [Andrew Or] Make all test suites extend SparkFunSuite instead of FunSuite bbce12e [Andrew Or] Fix manual things that cannot be covered through automation da0b12f [Andrew Or] Add core tests as dependencies in all modules f7d29ce [Andrew Or] Introduce base abstract class for all test suites

This patch fixes a build break in maven caused by apache#6441. Note that this patch reverts the changes in flume-sink because this module does not currently depend on Spark core, but the tests require it. There is not an easy way to make this work because mvn test dependencies are not transitive (MNG-1378). For now, we will leave the one test suite in flume-sink out until we figure out a better solution. This patch is mainly intended to unbreak the maven build. Author: Andrew Or <[email protected]> Closes apache#6511 from andrewor14/fix-build-mvn and squashes the following commits: 3d53643 [Andrew Or] [HOT FIX apache#6441] Fix maven build failures

This is a follow-up patch to apache#6441. Author: Andrew Or <[email protected]> Closes apache#6510 from andrewor14/extends-funsuite-check and squashes the following commits: 6618b46 [Andrew Or] Exempt SparkSinkSuite from the FunSuite check 99d02ac [Andrew Or] Merge branch 'master' of github.com:apache/spark into extends-funsuite-check 48874dd [Andrew Or] Guard against direct uses of FunSuite / FunSuiteLike

This is a workaround for MSHADE-148, which leads to an infinite loop when building Spark with maven 3.3.x. This was originally caused by #6441, which added a bunch of test dependencies on the spark-core test module. Recently, it was revealed by #7193. This patch adds a `-Prelease` profile. If present, it will set `createDependencyReducedPom` to true. The consequences are: - If you are releasing Spark with this profile, you are fine as long as you use maven 3.2.x or before. - If you are releasing Spark without this profile, you will run into SPARK-8781. - If you are not releasing Spark but you are using this profile, you may run into SPARK-8819. - If you are not releasing Spark and you did not include this profile, you are fine. This is all documented in `pom.xml` and tested locally with both versions of maven. Author: Andrew Or <[email protected]> Closes #7219 from andrewor14/fix-maven-build and squashes the following commits: 1d37e87 [Andrew Or] Merge branch 'master' of github.com:apache/spark into fix-maven-build 3574ae4 [Andrew Or] Review comments f39199c [Andrew Or] Create a -Prelease profile that flags `createDependencyReducedPom` (cherry picked from commit 9eae5fa) Signed-off-by: Andrew Or <[email protected]>

This is a workaround for MSHADE-148, which leads to an infinite loop when building Spark with maven 3.3.x. This was originally caused by #6441, which added a bunch of test dependencies on the spark-core test module. Recently, it was revealed by #7193. This patch adds a `-Prelease` profile. If present, it will set `createDependencyReducedPom` to true. The consequences are: - If you are releasing Spark with this profile, you are fine as long as you use maven 3.2.x or before. - If you are releasing Spark without this profile, you will run into SPARK-8781. - If you are not releasing Spark but you are using this profile, you may run into SPARK-8819. - If you are not releasing Spark and you did not include this profile, you are fine. This is all documented in `pom.xml` and tested locally with both versions of maven. Author: Andrew Or <[email protected]> Closes #7219 from andrewor14/fix-maven-build and squashes the following commits: 1d37e87 [Andrew Or] Merge branch 'master' of github.com:apache/spark into fix-maven-build 3574ae4 [Andrew Or] Review comments f39199c [Andrew Or] Create a -Prelease profile that flags `createDependencyReducedPom`

This is a workaround for MSHADE-148, which leads to an infinite loop when building Spark with maven 3.3.x. This was originally caused by #6441, which added a bunch of test dependencies on the spark-core test module. Recently, it was revealed by #7193. This patch adds a `-Prelease` profile. If present, it will set `createDependencyReducedPom` to true. The consequences are: - If you are releasing Spark with this profile, you are fine as long as you use maven 3.2.x or before. - If you are releasing Spark without this profile, you will run into SPARK-8781. - If you are not releasing Spark but you are using this profile, you may run into SPARK-8819. - If you are not releasing Spark and you did not include this profile, you are fine. This is all documented in `pom.xml` and tested locally with both versions of maven. Author: Andrew Or <[email protected]> Closes #7219 from andrewor14/fix-maven-build and squashes the following commits: 1d37e87 [Andrew Or] Merge branch 'master' of github.com:apache/spark into fix-maven-build 3574ae4 [Andrew Or] Review comments f39199c [Andrew Or] Create a -Prelease profile that flags `createDependencyReducedPom` Conflicts: dev/create-release/create-release.sh pom.xml

Andrew Or added 2 commits May 26, 2015 20:34

Introduce base abstract class for all test suites

f7d29ce

Add core tests as dependencies in all modules

da0b12f

This is such that test suites in all modules can extend SparkFunSuite.

Fix manual things that cannot be covered through automation

bbce12e

Make all test suites extend SparkFunSuite instead of FunSuite

69cbb24

This is a big commit. In addition to just doing a search and replace there is actually more work to do in ensuring that the correct imports are introduced and the unused ones removed. This step is largely automated. :)

andrewor14 force-pushed the demarcate-tests branch from 35ee432 to 69cbb24 Compare May 27, 2015 21:57

Andrew Or added 2 commits May 27, 2015 15:07

Various whitespace changes (minor)

12d1e1b

Fix log message

ee22cda

andrewor14 force-pushed the demarcate-tests branch from ed3d5f2 to ee22cda Compare May 28, 2015 00:20

Fix tests?

c43ffc4

Andrew Or added 2 commits May 28, 2015 12:36

Merge branch 'master' of github.com:apache/spark into demarcate-tests

c7460c0

Fix tests after logical merge conflict

7790b6c

asfgit closed this in 9eb222c May 29, 2015

andrewor14 deleted the demarcate-tests branch May 29, 2015 21:13

andrewor14 referenced this pull request May 29, 2015

[HOTFIX] [SQL] Maven test compilation issue

8c99793

Tests compile in SBT but not Maven.

andrewor14 mentioned this pull request May 29, 2015

[SPARK-7558] Guard against direct uses of FunSuite / FunSuiteLike #6510

Closed

andrewor14 mentioned this pull request May 30, 2015

[HOT FIX] [BUILD] Fix maven build failures #6511

Closed

This was referenced Jun 3, 2015

[SPARK-7558] Demarcate tests in unit-tests.log (1.3) #6602

Closed

[SPARK-7558] Demarcate tests in unit-tests.log (1.4) #6598

Closed

andrewor14 mentioned this pull request Jul 4, 2015

[SPARK-8819] Fix build for maven 3.3.x #7219

Closed

steveloughran mentioned this pull request Jan 23, 2024

[SPARK-35878][CORE] Revert S3A endpoint fixup logic of SPARK-35878 #44834

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[SPARK-7558] Demarcate tests in unit-tests.log #6441

[SPARK-7558] Demarcate tests in unit-tests.log #6441

andrewor14 commented May 27, 2015

andrewor14 commented May 27, 2015

JoshRosen commented May 27, 2015

SparkQA commented May 27, 2015

pwendell commented May 27, 2015

andrewor14 commented May 27, 2015

SparkQA commented May 27, 2015

SparkQA commented May 28, 2015

SparkQA commented May 28, 2015

andrewor14 commented May 28, 2015

pwendell commented May 28, 2015

andrewor14 commented May 28, 2015

andrewor14 commented May 28, 2015

andrewor14 commented May 28, 2015

SparkQA commented May 28, 2015

JoshRosen commented May 28, 2015

SparkQA commented May 28, 2015

andrewor14 commented May 28, 2015

SparkQA commented May 29, 2015

andrewor14 commented May 29, 2015

andrewor14 commented May 30, 2015

steveloughran commented Jun 1, 2015

[SPARK-7558] Demarcate tests in unit-tests.log #6441

[SPARK-7558] Demarcate tests in unit-tests.log #6441

Conversation

andrewor14 commented May 27, 2015

andrewor14 commented May 27, 2015

JoshRosen commented May 27, 2015

SparkQA commented May 27, 2015

pwendell commented May 27, 2015

andrewor14 commented May 27, 2015

SparkQA commented May 27, 2015

SparkQA commented May 28, 2015

SparkQA commented May 28, 2015

andrewor14 commented May 28, 2015

pwendell commented May 28, 2015

andrewor14 commented May 28, 2015

andrewor14 commented May 28, 2015

andrewor14 commented May 28, 2015

SparkQA commented May 28, 2015

JoshRosen commented May 28, 2015

SparkQA commented May 28, 2015

andrewor14 commented May 28, 2015

SparkQA commented May 29, 2015

andrewor14 commented May 29, 2015

andrewor14 commented May 30, 2015

steveloughran commented Jun 1, 2015